-- Logs begin at Mon 2022-06-06 12:14:14 UTC, end at Mon 2022-06-06 13:26:54 UTC. -- Jun 06 12:59:01.488371 dv-cinder-755101-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 06 12:59:01.497505 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 06 12:59:01.499454 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 12:59:01 2022] *** Jun 06 12:59:01.499454 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 12:59:01.499454 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 12:59:01.499454 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: nodename: dv-cinder-755101-10-iscsi Jun 06 12:59:01.499454 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: machine: x86_64 Jun 06 12:59:01.499454 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: clock source: unix Jun 06 12:59:01.499454 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: pcre jit disabled Jun 06 12:59:01.499454 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: detected number of CPU cores: 4 Jun 06 12:59:01.499454 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: current working directory: / Jun 06 12:59:01.499454 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: detected binary path: /usr/bin/uwsgi-core Jun 06 12:59:01.500188 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: your processes number limit is 47680 Jun 06 12:59:01.500188 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: your memory page size is 4096 bytes Jun 06 12:59:01.500188 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: detected max file descriptor number: 2048 Jun 06 12:59:01.500188 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: lock engine: pthread robust mutexes Jun 06 12:59:01.500188 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: thunder lock: enabled Jun 06 12:59:01.500188 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 06 12:59:01.500188 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 12:59:01.545678 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: Python main interpreter initialized at 0x55e6ac8c39c0 Jun 06 12:59:01.545678 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: python threads support enabled Jun 06 12:59:01.545678 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: your server socket listen backlog is limited to 100 connections Jun 06 12:59:01.545678 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: your mercy for graceful operations on workers is 90 seconds Jun 06 12:59:01.546003 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 12:59:01.546159 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: *** Operational MODE: preforking *** Jun 06 12:59:01.546353 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: *** uWSGI is running in multiple interpreter mode *** Jun 06 12:59:01.546353 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: spawned uWSGI master process (pid: 103685) Jun 06 12:59:01.546533 dv-cinder-755101-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 06 12:59:01.547090 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: spawned uWSGI worker 1 (pid: 103686, cores: 1) Jun 06 12:59:01.547419 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: spawned uWSGI worker 2 (pid: 103687, cores: 1) Jun 06 12:59:01.547613 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 12:59:02.763919 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 12:59:02.783672 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 12:59:03.482736 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 12:59:03.482736 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: from cryptography.utils import int_from_bytes Jun 06 12:59:03.483069 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 12:59:03.483069 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: from cryptography.utils import int_from_bytes Jun 06 12:59:03.484080 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 12:59:03.484080 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: from cryptography.utils import int_from_bytes Jun 06 12:59:03.484426 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 12:59:03.484426 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: from cryptography.utils import int_from_bytes Jun 06 12:59:06.034891 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 12:59:06.035511 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 12:59:06.035915 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 12:59:06.036006 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 12:59:06.036089 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 12:59:06.036178 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 12:59:06.036259 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 12:59:06.036347 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 12:59:06.036461 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 12:59:06.036552 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 12:59:06.036639 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.036859 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.036958 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.037181 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.037283 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.037502 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.037592 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.037819 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.037935 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.038138 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.038228 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.038446 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.038534 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.038761 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.038876 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.039075 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.039164 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.039329 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.039429 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.039671 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.039776 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.039986 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.040074 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-755101-10-iscsi {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.040302 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.040388 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-755101-10-iscsi {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.040606 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.040695 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.040923 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.041010 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.041233 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.041330 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.042217 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.042367 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.042629 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.042785 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.042915 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.043051 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.043365 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.043454 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.043868 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.044014 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.044197 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.044304 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.044473 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.044580 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.044797 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.044907 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.045104 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.045292 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.045410 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.045549 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.045723 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.045812 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.046025 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.046114 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.046331 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.046419 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.046636 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.046766 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.046949 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.047046 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-755101-10-iscsi {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.047330 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.047427 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-755101-10-iscsi {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.047659 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.047758 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.047968 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.048069 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.048273 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.048383 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.048674 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.048768 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.048968 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.049065 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.049273 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.049369 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.049588 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.049687 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.049892 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.049989 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.050199 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.050295 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.050511 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.050617 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.050825 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.050923 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.051141 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.051227 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.051437 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.051554 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.051764 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.051865 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.052067 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.052155 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.052373 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.052467 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.052674 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.052776 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.052971 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.053061 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.053218 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.053308 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.053508 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.053594 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.053812 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.053900 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.054134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.054223 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.054447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.054537 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.054695 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.054784 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.054941 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.055032 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.055243 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.055356 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.055575 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.055684 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.055883 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.055972 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.056184 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.056272 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.056486 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.056584 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.056788 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.056877 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.057136 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.057249 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.057537 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.057696 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.057852 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.057971 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.058128 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.058218 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.058431 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.058521 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.058744 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.058840 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.059058 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.059159 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.059357 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.059446 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.059691 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.059781 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.060012 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.060145 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.060395 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.060489 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.060645 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.060739 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.060956 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.061057 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.061293 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.061382 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.061609 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.061703 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.061915 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.062012 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.062227 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.062314 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.062530 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.062631 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.062830 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.062930 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.063132 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.063233 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.063434 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.063543 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.063773 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.063863 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.064075 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.064164 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.064323 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.064411 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.064617 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.064706 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.064914 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.065003 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.065216 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.065310 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.065516 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.065645 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.065817 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.065915 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.066117 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.066215 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.066413 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.066503 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.066708 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.066803 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.067007 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.067097 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.067308 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.067397 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.067627 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.067732 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.067928 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.068031 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.068226 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.068324 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.068525 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.068613 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.068821 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.068921 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.069123 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.069238 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.069424 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.069522 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.069733 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.069840 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.070031 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.070130 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.070329 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.070428 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.070628 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.070734 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.070924 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.071030 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.071226 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.071324 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.071539 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.071650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.071839 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.071944 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.072147 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.072250 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.072440 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.072563 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.072777 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.072927 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.073080 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.073229 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.073368 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.073467 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.073666 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.073764 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.073966 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.074053 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.074257 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.074357 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.074555 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.074644 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.074858 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.074945 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.075156 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.075245 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.075457 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.075636 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.075780 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.075920 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.076076 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.076223 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.076360 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.076498 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.076637 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.076785 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.076932 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.077076 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.077216 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.077374 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.077525 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.077662 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.077809 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.077947 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.078082 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.078220 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.078364 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.078512 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.078659 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.078805 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.078941 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.079077 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.079233 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.079333 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.079565 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.079658 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 12:59:06.079892 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.079982 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.080221 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.080325 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.080533 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.080622 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.080860 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.080958 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.081187 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.081278 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.081500 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.081598 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.081811 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.081902 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.082123 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.082212 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.082438 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.082546 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.082743 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.082835 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.083048 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.083146 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.083357 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.083446 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.083691 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.083780 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.084005 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.084104 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.084321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.084425 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.084632 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.084720 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.084946 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.085037 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.085259 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.085346 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.085564 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.085652 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.085872 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.085960 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.086188 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.086279 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.086503 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.086592 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.086811 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.086915 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.087120 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.087209 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.087460 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.087628 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.087792 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.087880 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.088113 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.088203 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.089009 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.089185 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.089338 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.089485 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.089718 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.089811 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.090030 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.090130 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.090341 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.090430 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.090667 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.090766 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.090975 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.091064 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.091291 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.091389 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.091621 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.091729 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.091932 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.092024 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.092248 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.092337 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.092548 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.092634 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.092853 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.092960 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.093159 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.093246 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.093488 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.093585 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.093800 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.093888 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.094104 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.094191 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.094414 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.094501 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.094720 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.094816 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.095027 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.095115 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.095331 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.095429 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.095654 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.095757 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.095958 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.096047 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.096258 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.096361 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.096557 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.096645 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.096855 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.096943 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.097155 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.097251 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.097473 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.097563 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.097775 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.097891 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.098093 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.098195 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.098394 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.098484 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.098701 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.098798 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.099009 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.099097 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.099312 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.099401 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.099635 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.099744 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.099941 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.100030 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.100246 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.100333 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.100548 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.100636 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.100857 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.100952 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.101163 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.101250 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.101465 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.101565 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.101767 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.101863 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.102071 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.102159 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.102374 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.102472 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.102680 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.102768 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.102983 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.103073 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.103292 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.103388 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.103623 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.103716 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.103978 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.104655 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.104809 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.104984 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.105134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.105223 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.105436 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.105525 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.105750 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.105903 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.106084 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.106174 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.106414 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.106504 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.106721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.106812 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.107047 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.107144 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.107355 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.107450 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.107679 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.107770 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.107986 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.108077 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.108286 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.108375 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.108585 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.108682 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.108883 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.108979 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.109183 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.109271 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.109478 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.109614 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.109782 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.109891 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.110080 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.110177 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.110378 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.110475 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.110676 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.110765 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.110976 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.111072 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.111279 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.111366 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.111605 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.111699 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.111905 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.112009 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.112205 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.112293 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.112506 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.112595 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.112827 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.112923 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.113141 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.113240 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.113479 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.113581 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.113795 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.113885 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.114106 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.114203 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.114413 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.114510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.114722 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.114810 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.115023 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.115119 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.115328 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.115417 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.115658 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.115749 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.115963 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.116050 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.116269 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.116357 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.116571 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.116666 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.116880 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.116969 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.117182 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.117270 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.117491 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.117580 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.117793 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.117881 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.118104 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.118206 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.118404 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.118493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.118703 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.118792 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.119016 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.119113 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.119346 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.119478 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.119721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.119882 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.120033 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.120197 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.120346 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.120498 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.120662 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.120812 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.120975 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.121115 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.121283 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.121420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.121590 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.121723 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.121899 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.122027 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.122209 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.122339 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.122525 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.122643 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.122833 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.122955 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.123152 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.123274 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.123459 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.123637 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.123846 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.123967 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.124161 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.124270 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.124467 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.124556 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.124770 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.124867 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.125083 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.125172 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.125408 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.125496 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.125711 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.125807 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.126019 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.126128 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.126331 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.126428 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.126634 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.126728 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.126940 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.127030 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.127245 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.127348 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.127580 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.127735 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.127885 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.128038 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.128178 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.128326 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.128464 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.128601 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.128738 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.128875 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.129037 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.129187 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.129324 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.129472 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.129633 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.129774 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.129925 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.130062 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.130227 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.130374 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.130512 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.130658 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.130804 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.130944 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.131122 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.131274 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.131430 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.131599 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.131764 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.131853 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.132077 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.132173 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.132378 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.132474 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.132676 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.132766 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.132975 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.133062 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.133288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.133386 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.133587 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.133676 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.133886 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.133973 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.134181 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.134285 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.134482 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.134570 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.134809 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.134897 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.135112 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.135224 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.135466 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.135652 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.135806 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.135958 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.136098 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.136204 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.136405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.136495 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.136708 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.136797 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.137021 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.137117 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.137313 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.137404 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.137621 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.137709 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.137923 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.138013 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.138227 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.138326 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.138532 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.138623 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.138836 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.138927 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.139140 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.139230 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.139447 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.139582 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.139771 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.139868 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.140075 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.140172 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.140379 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.140478 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.140675 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.140764 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.140979 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.141067 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.141289 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.141391 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.141608 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.141898 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.142168 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.142258 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.142502 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.142601 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.142817 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.142906 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.143136 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.143231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.143456 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.143587 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.143804 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.143894 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.144127 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.144216 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.144451 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.144549 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.144753 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.144855 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.145062 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.145161 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.145363 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.145452 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.145663 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.145760 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.145963 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.146066 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.146271 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.146361 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.146574 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.146672 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.146877 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.146966 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.147177 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.147273 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.147483 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.147593 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.147808 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.147906 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.148109 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.148212 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.148408 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.148497 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.148711 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.148800 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.149010 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.149105 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.149309 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.149397 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.149607 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.149701 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.149906 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.150225 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.150358 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.150537 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.150625 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.151372 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.151549 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.151719 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.151877 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.152020 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.152112 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.152312 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.152411 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.152616 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.152706 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.152948 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.153036 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.153268 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.153355 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.153605 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.153705 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.153909 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.154006 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.154209 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.154306 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.154529 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.154695 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.154854 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.155015 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.155167 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.155367 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.155520 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.155700 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.155858 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.156019 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.156223 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.156391 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.156800 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.156952 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.157099 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.157246 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.157394 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.157550 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.157698 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.157853 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.158001 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.158155 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.158315 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.158482 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.158635 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.158790 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.158938 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.159084 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.159240 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.159387 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.159561 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.159717 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.159863 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.160021 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.160179 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.160350 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.160500 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.160654 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.160801 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.160948 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.161104 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.161252 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.161399 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.161548 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.161694 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.161841 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.162067 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.162217 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.162377 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.162524 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.162672 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.162833 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.162987 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.163134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.163280 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.163426 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.163636 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.163804 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.163952 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.164098 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.164256 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.164410 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.164557 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.164713 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.164862 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.165024 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.165173 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.165320 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.165467 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.165669 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.165822 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.165970 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.166116 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.166280 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.167047 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.167181 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.167318 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.167466 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.167636 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.167787 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.167912 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.167998 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.168087 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.168237 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.168332 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.168426 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.168521 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.168604 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.168693 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.168775 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.168864 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.168947 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.169041 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.169130 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.169219 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.169308 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.169390 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.169485 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.169615 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.169706 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.169914 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.170027 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.170227 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.170332 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.170529 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.170620 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.170827 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.170916 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.171127 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.171225 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.171425 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.171514 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.171787 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.171877 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.172088 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.172191 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.172439 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.172530 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.172739 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.172829 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.173047 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.173138 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.173363 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.173457 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.173670 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.173766 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.173974 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.174064 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.174281 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.174383 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.174585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.174713 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.174891 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.174994 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.175194 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.175295 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.175500 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.175653 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.175820 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.175926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.176116 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.176207 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.176431 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.176522 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.176734 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.176825 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.177035 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.177124 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.177349 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.177447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.177663 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.177760 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.177979 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.178069 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.178279 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.178383 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.178580 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.178668 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.178881 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.178968 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.179182 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.179280 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.179484 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.179607 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.179853 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.179954 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.180112 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.180212 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.180417 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.180507 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.180723 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.180812 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.181027 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.181117 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.181333 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.181429 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.181634 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.181722 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.181939 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.182032 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.182270 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.182376 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.182572 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.182663 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.182887 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.182976 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.183191 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.183286 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.183487 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.183626 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.183818 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.183905 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.184115 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.184210 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.184419 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.184518 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.184718 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.184818 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.185139 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.185228 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.185444 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.185543 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.185750 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.185839 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.186052 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.186141 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.186357 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.186455 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.186659 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.186749 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.186968 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.187058 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.187279 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.187376 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.187596 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.187689 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.188006 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.188095 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.188313 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.188404 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.188617 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.188706 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.188922 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.189012 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.189221 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.189311 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.189519 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.189612 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.189820 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.189931 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.190143 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.190266 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.190443 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.190544 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.190739 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.190838 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.191038 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.191185 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.191352 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.191510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.191705 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.191859 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.191999 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.192136 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.192367 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.192508 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.192675 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.192823 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.192963 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.193098 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.193371 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.193513 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.193682 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.193833 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.193972 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.194107 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.194287 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.194428 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.194603 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.194763 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.194922 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.195058 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.195199 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.195359 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.195515 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.195675 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.195824 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.195971 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.196111 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.196248 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.196419 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.196581 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.196723 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.196862 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.197022 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.197164 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.197309 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.197459 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.197645 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.197821 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.198042 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.198283 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.198427 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.198576 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.198723 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.198860 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.198997 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.199135 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.199274 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.199424 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.199595 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.199714 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.199896 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.200101 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.200206 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.200427 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.200525 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.200639 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.200796 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.200941 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.201110 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.201248 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.201413 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.201549 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.201715 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.201849 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.202037 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.202167 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.202341 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.202468 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.202651 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.202773 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.202959 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.203078 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.203266 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.203382 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.203590 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.203708 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.203898 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.203997 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.204217 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.204306 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.204522 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.204621 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.204841 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.204985 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.205153 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.205242 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.205473 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.205563 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.205791 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.205882 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.206093 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.206181 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.206412 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.206507 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.206715 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.206805 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.207016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.207105 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.207313 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.207411 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.207634 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.207727 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.207974 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.208064 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.208275 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.208377 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.208590 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.208687 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.208913 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.209004 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.209235 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.209334 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.209539 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.209629 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.209867 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.209959 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.210189 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.210327 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.210499 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.210600 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.210812 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.210911 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.211131 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.211231 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.211432 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.211552 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.211750 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.211849 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.212055 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.212145 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.212350 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.212438 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.212649 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.212739 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.212948 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.213039 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.213784 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.213891 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.214104 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.214202 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.214408 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.214516 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.214709 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.214823 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.215026 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.215142 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.215326 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.215415 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.215671 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.215766 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.215980 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.216081 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.216283 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.216372 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.216587 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.216677 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.216887 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.216989 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.217226 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.217316 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.217526 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.217622 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.217856 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.217945 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.218169 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.218258 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.218485 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.218581 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.218806 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.218895 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.219111 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.219199 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.219428 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.219517 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.219766 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.219858 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.220076 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.220167 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.220386 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.220474 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.220697 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.220793 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.221004 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.221092 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.221313 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.221401 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.221621 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.221710 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.221925 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.222015 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.222232 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.222330 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.222540 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.222632 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.222849 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.222950 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.223375 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.223475 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.223723 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.223816 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.224035 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.224132 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.224342 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.224440 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.224648 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.224736 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.224952 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.225040 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.225260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.225353 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.225565 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.225653 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.225869 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.225957 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.226171 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.226268 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.226475 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.226565 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.226795 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.226892 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.227108 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.227207 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.227427 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.227516 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.227779 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.227882 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.228089 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.228177 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.228397 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.228485 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.228705 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.228802 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.229103 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.229195 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.229461 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.229562 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.229776 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.229869 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.230081 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.230171 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.230394 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.230532 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.230710 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.230810 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.231016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.231104 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.231322 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.231411 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.231654 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.231747 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.231966 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.232056 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.232273 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.232377 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.232581 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.232670 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.232887 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.232976 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.233196 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.233295 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.233504 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.233603 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.233825 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.233914 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.234155 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.234252 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.234471 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.234559 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.234776 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.234864 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.235086 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.235177 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.235398 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.235496 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.235933 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.236023 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.236245 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.236335 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.236573 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.236661 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.236893 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.236983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.237215 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.237307 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.237524 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.237620 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.237838 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.237935 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.238160 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.238250 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.238464 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.238552 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.238760 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.238861 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.239066 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.239154 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.239367 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.239455 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.239687 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.239796 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.240001 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.240091 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.240306 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.240395 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.240606 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.240704 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.240917 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.241005 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.241221 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.241312 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.241741 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.241832 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.242080 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.242170 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.242390 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.242479 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.242709 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.242800 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.243032 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.243121 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.243351 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.243441 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.243686 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.243779 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.244014 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.244104 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.244324 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.244413 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.245179 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.245279 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.245494 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.245573 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.245803 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.245916 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.246104 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.246194 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.246406 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.246496 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.246712 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.246815 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.247017 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.247110 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.247316 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.247412 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.247647 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.247754 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.247948 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.248037 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.248270 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.248368 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.248571 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.248671 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.248872 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.248962 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.249171 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.249274 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.249478 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.249569 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.249781 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.249869 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.250079 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.250168 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.250380 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.250471 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.250681 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.250769 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.250986 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.251077 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.251284 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.251375 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.251620 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.251745 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.251926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.252045 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.252228 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.252329 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.252528 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.252636 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.252830 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.252940 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.253175 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.253272 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.253491 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.253589 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.253794 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.253902 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.254092 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.254198 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.254401 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.254499 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.254703 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.254810 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.255020 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.255127 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.255326 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.255461 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.255663 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.255773 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.255982 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.256093 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.256291 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.256381 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.256813 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.256904 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.257141 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.257232 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.257456 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.257546 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.257781 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.257873 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.258106 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.258197 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.258409 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.258500 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.258709 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.258801 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.259011 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.259107 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.259325 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.259421 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.259656 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.259755 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.259959 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.260048 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.260340 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.260505 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.260746 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.260890 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.261061 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.261215 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.261347 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.261448 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.261655 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.261745 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.261960 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.262057 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.262266 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.262366 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.262573 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.262670 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.262876 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.262965 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.263184 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.263281 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.263486 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.263589 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.263820 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.263911 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.264159 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.264256 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.264470 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.264565 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.264783 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.264874 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.265093 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.265181 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.265400 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.265489 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.265706 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.265819 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.266006 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.266096 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.266311 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.266407 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.266612 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.266716 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.266922 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.267012 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.267246 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.267334 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.267567 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.267677 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.267871 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.267962 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.268280 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.268370 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.268588 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.268678 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.268902 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.268990 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.269216 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.269303 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.269523 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.269614 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.269838 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.269936 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.270155 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.270247 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.270462 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.270552 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.270775 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.270872 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.271091 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.271198 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.271406 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.271494 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.271759 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.271851 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.272085 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.272184 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.272404 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.272495 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.272705 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.272795 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.273004 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.273103 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.273305 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.273393 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.273608 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.273696 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.273923 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.274026 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.274227 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.274315 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.274525 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.274615 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.274821 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.274913 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.275125 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.275214 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.275424 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.275512 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.275842 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.275985 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.276140 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.276292 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.276462 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.276623 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.276730 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.276956 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.277070 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.277258 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.277372 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.277558 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.277683 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.277861 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.277963 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.278159 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.278258 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.278457 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.278564 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.278754 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.278852 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.279053 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.279155 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.279349 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.279447 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.279673 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.279774 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.279973 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.280064 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.280270 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.280368 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.280565 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.280654 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.280891 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.280997 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.281218 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.281327 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.281521 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.281872 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.282100 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.282199 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.282403 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.282491 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.282713 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.282802 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.283014 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.283111 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.283330 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.283419 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.283663 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.283756 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.283973 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.284073 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.284277 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.284365 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.284598 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.284693 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.284901 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.284999 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.285209 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.285298 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.285512 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.285600 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.285819 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.285926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.286125 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.286243 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.286427 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.286519 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.286746 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.286847 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.287048 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.287138 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.287353 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.287449 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.287694 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.287786 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.288009 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.288099 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.288321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.288488 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.288628 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.288718 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.288933 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.289023 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.289244 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.289345 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.289545 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.289633 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.289847 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.289937 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.290152 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.290252 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.290454 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.290549 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.290758 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.290849 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.291069 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.291158 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.291903 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.292040 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.292261 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.292503 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.292625 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.292868 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.292959 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.293188 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.293446 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.293535 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.293804 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.293895 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.294131 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.294228 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.294473 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.294573 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.294796 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.294893 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.295106 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.295196 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.295413 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.295514 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.295738 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.295832 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.295978 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103686) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 12:59:06.296107 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 12:59:06.296348 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=103687) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 12:59:06.353741 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO dbcounter [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Registered counter for database nova_api Jun 06 12:59:06.354650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO dbcounter [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] Registered counter for database nova_api Jun 06 12:59:06.374595 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_db.sqlalchemy.engines [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:59:06.377986 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG oslo_db.sqlalchemy.engines [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:59:06.383945 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writer thread running {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:59:06.384464 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writer thread running {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:59:06.440270 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.context [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96733054-82d0-4cbf-8560-31148af40a94(cell1) {{(pid=103686) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 12:59:06.440832 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.context [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96733054-82d0-4cbf-8560-31148af40a94(cell1) {{(pid=103687) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 12:59:06.444293 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:59:06.444933 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG oslo_concurrency.lockutils [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:59:06.445954 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:59:06.446481 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG oslo_concurrency.lockutils [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:59:06.446730 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:59:06.447262 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG oslo_concurrency.lockutils [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 12:59:06.449232 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:59:06.449946 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG oslo_concurrency.lockutils [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=103687) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 12:59:06.451169 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO dbcounter [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Registered counter for database nova_cell0 Jun 06 12:59:06.451925 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO dbcounter [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] Registered counter for database nova_cell0 Jun 06 12:59:06.455133 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO dbcounter [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Registered counter for database nova_cell1 Jun 06 12:59:06.455861 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO dbcounter [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] Registered counter for database nova_cell1 Jun 06 12:59:06.462336 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_db.sqlalchemy.engines [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:59:06.464690 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG oslo_db.sqlalchemy.engines [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:59:06.468899 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writer thread running {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:59:06.469409 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writer thread running {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:59:06.469547 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_db.sqlalchemy.engines [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:59:06.470048 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG oslo_db.sqlalchemy.engines [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:59:06.611269 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writer thread running {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:59:06.611486 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writer thread running {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:59:06.620045 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO dbcounter [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] Registered counter for database nova_cell0 Jun 06 12:59:06.620258 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO dbcounter [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Registered counter for database nova_cell0 Jun 06 12:59:06.626843 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG oslo_db.sqlalchemy.engines [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103687) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:59:06.630365 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_db.sqlalchemy.engines [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=103686) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 12:59:06.631258 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writer thread running {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:59:06.634727 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writer thread running {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 12:59:07.176297 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: WARNING keystonemiddleware.auth_token [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 12:59:07.179652 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: WARNING keystonemiddleware.auth_token [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 12:59:07.184068 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: WARNING keystonemiddleware.auth_token [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 12:59:07.186961 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: WARNING keystonemiddleware.auth_token [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 12:59:07.414199 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: WARNING keystonemiddleware.auth_token [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 12:59:07.420198 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: WARNING keystonemiddleware.auth_token [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 12:59:07.420398 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: WARNING keystonemiddleware.auth_token [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 12:59:07.426199 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: WARNING keystonemiddleware.auth_token [None req-08cedd1d-2ed2-4258-b607-86c91a621351 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 12:59:07.426584 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e6ac8c39c0 pid: 103686 (default app) Jun 06 12:59:07.428614 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 12:59:07.429805 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] 10.222.0.13 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.001714 Jun 06 12:59:07.430216 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 1/1] 10.222.0.13 () {50 vars in 788 bytes} [Mon Jun 6 12:59:07 2022] GET /compute/v2.1/ => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 12:59:07.431350 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x55e6ac8c39c0 pid: 103687 (default app) Jun 06 13:00:28.824945 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:28.825945 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Jun 06 13:00:28.826362 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 2/2] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:00:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:00:28.844983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_api:SELECT=3 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:28.846095 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_cell1:SELECT=3 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:28.847090 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_cell0:SELECT=3 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:28.847853 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:29.297600 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-62d2e139-fe4f-4211-93dc-6fcf40f471aa admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:29.331786 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-62d2e139-fe4f-4211-93dc-6fcf40f471aa admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.495992 Jun 06 13:00:29.339640 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 1/3] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jun 6 13:00:28 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 501 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:00:31.645477 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:31.647747 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-4891fddd-76f2-4917-bd18-809a267b1c6d None None] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002631 Jun 06 13:00:31.648215 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 3/4] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:00:31 2022] GET /compute/v2.1 => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:00:31.707873 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-3b6177d6-f140-4e94-8065-5a27bb50e229 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "swap": 0, "os-flavor-access:is_public": true, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "cirros256", "ram": 256, "id": "c1"}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:31.726735 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:00:31.726735 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: warnings.warn(msg) Jun 06 13:00:31.814402 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-3b6177d6-f140-4e94-8065-5a27bb50e229 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.160207 Jun 06 13:00:31.818906 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 2/5] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 13:00:31 2022] POST /compute/v2.1/flavors => generated 407 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:00:31.830629 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_api:SELECT=3 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:31.833391 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_cell0:SELECT=3 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:31.835425 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_cell1:SELECT=3 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:31.836494 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:00:32.053527 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-0c15f03e-285e-4a2e-807b-aa938cb23d20 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:32.055974 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:00:32.055974 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: warnings.warn(msg) Jun 06 13:00:32.188662 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-0c15f03e-285e-4a2e-807b-aa938cb23d20 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.363980 Jun 06 13:00:32.189638 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 4/6] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 6 13:00:31 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 366 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:00:34.629967 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-3b6177d6-f140-4e94-8065-5a27bb50e229 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:34.631162 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-3b6177d6-f140-4e94-8065-5a27bb50e229 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001629 Jun 06 13:00:34.631746 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 3/7] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:00:34 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:00:34.738888 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-92aa3184-4f5c-4b91-8ef8-7160f607f27a admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "ram": 512, "vcpus": 1, "disk": 5, "name": "ds512M", "id": "d1", "os-flavor-access:is_public": true}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:34.757452 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-manage:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:00:34.757452 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: warnings.warn(msg) Jun 06 13:00:34.860616 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-92aa3184-4f5c-4b91-8ef8-7160f607f27a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.223214 Jun 06 13:00:34.861700 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 5/8] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 13:00:34 2022] POST /compute/v2.1/flavors => generated 404 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:00:34.873837 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-4ecf66ea-3c42-49f1-8211-ad4c18702364 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:34.876516 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-flavor-extra-specs:create": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:00:34.876516 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: warnings.warn(msg) Jun 06 13:00:34.965640 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-4ecf66ea-3c42-49f1-8211-ad4c18702364 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095411 Jun 06 13:00:34.966631 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 4/9] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 6 13:00:34 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:00:37.283095 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-92aa3184-4f5c-4b91-8ef8-7160f607f27a admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:37.284145 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-92aa3184-4f5c-4b91-8ef8-7160f607f27a admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 06 13:00:37.284667 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 6/10] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:00:37 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:00:37.346247 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-f44eb629-5e2d-4ff7-9ba9-74e0e1ce8bde admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "id": "d2", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 1024}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:37.435705 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-f44eb629-5e2d-4ff7-9ba9-74e0e1ce8bde admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.144532 Jun 06 13:00:37.436637 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 5/11] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 13:00:37 2022] POST /compute/v2.1/flavors => generated 404 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:00:37.448841 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-ca5040b8-b7ab-4bfc-8ab2-c21cb283e9d9 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:37.540904 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-ca5040b8-b7ab-4bfc-8ab2-c21cb283e9d9 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095888 Jun 06 13:00:37.541445 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 7/12] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 6 13:00:37 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:00:39.861037 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-f44eb629-5e2d-4ff7-9ba9-74e0e1ce8bde admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:39.862194 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-f44eb629-5e2d-4ff7-9ba9-74e0e1ce8bde admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001673 Jun 06 13:00:39.862682 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 6/13] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:00:39 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:00:39.928291 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-5e7e90ac-39c6-4f92-bb28-ad6e5cefb0d5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 2, "rxtx_factor": 1.0, "disk": 10, "swap": 0, "name": "ds2G", "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3"}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:40.000245 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-5e7e90ac-39c6-4f92-bb28-ad6e5cefb0d5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.130546 Jun 06 13:00:40.000805 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 8/14] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 13:00:39 2022] POST /compute/v2.1/flavors => generated 404 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:00:40.013376 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-b43d4e28-656d-4a6c-b3ff-b9f7350d0c19 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:40.095560 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-b43d4e28-656d-4a6c-b3ff-b9f7350d0c19 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085526 Jun 06 13:00:40.096198 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 7/15] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 6 13:00:40 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:00:42.415038 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-5e7e90ac-39c6-4f92-bb28-ad6e5cefb0d5 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:42.416114 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-5e7e90ac-39c6-4f92-bb28-ad6e5cefb0d5 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001509 Jun 06 13:00:42.416510 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 9/16] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:00:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:00:42.477291 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-a5271370-c0c6-4156-a749-bfc854e36cb3 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "ram": 4096, "swap": 0, "id": "d4", "disk": 20, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "name": "ds4G"}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:42.548643 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-a5271370-c0c6-4156-a749-bfc854e36cb3 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.126451 Jun 06 13:00:42.549190 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 8/17] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 13:00:42 2022] POST /compute/v2.1/flavors => generated 404 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 13:00:42.561905 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-5a40ea70-c60e-4ae3-913a-03bd19a7ec15 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:42.654875 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-5a40ea70-c60e-4ae3-913a-03bd19a7ec15 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.096882 Jun 06 13:00:42.656012 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 10/18] 10.222.0.13 () {64 vars in 1335 bytes} [Mon Jun 6 13:00:42 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:00:44.978057 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-a5271370-c0c6-4156-a749-bfc854e36cb3 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:44.979101 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-a5271370-c0c6-4156-a749-bfc854e36cb3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001432 Jun 06 13:00:44.979505 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 9/19] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:00:44 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:00:45.040771 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-25279f27-2248-4276-bf0d-71355aae464f admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:45.064968 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-25279f27-2248-4276-bf0d-71355aae464f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.079261 Jun 06 13:00:45.065768 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 11/20] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jun 6 13:00:44 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:00:47.747422 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-a5271370-c0c6-4156-a749-bfc854e36cb3 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:47.748524 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-a5271370-c0c6-4156-a749-bfc854e36cb3 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001534 Jun 06 13:00:47.748920 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 10/21] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:00:47 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:00:47.818057 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-8f3c07aa-8b95-4280-8f7c-d9d2be829ca7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"rxtx_factor": 1.0, "disk": 1, "vcpus": 1, "id": "1", "ram": 512, "swap": 0, "os-flavor-access:is_public": true, "name": "m1.tiny", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:47.945302 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-8f3c07aa-8b95-4280-8f7c-d9d2be829ca7 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.184065 Jun 06 13:00:47.945302 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 12/22] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 13:00:47 2022] POST /compute/v2.1/flavors => generated 402 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:00:47.954124 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-cd3a3039-c5c8-47ab-9b19-1cc21b513009 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:48.044264 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-cd3a3039-c5c8-47ab-9b19-1cc21b513009 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.095001 Jun 06 13:00:48.044981 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 11/23] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 6 13:00:47 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:00:50.389451 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-8f3c07aa-8b95-4280-8f7c-d9d2be829ca7 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:50.390654 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-8f3c07aa-8b95-4280-8f7c-d9d2be829ca7 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001881 Jun 06 13:00:50.391123 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 13/24] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:00:50 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:00:50.453851 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-4becc793-726b-41aa-9003-3f916fedb2ba admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 1, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "disk": 20, "swap": 0, "ram": 2048, "name": "m1.small", "id": "2", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:50.532045 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-4becc793-726b-41aa-9003-3f916fedb2ba admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.133092 Jun 06 13:00:50.532606 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 12/25] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 13:00:50 2022] POST /compute/v2.1/flavors => generated 405 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 13:00:50.545195 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-4b828b8e-cf41-4740-bf78-92c6c1cf9656 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:50.627236 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-4b828b8e-cf41-4740-bf78-92c6c1cf9656 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085771 Jun 06 13:00:50.630035 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 14/26] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 6 13:00:50 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:00:52.946052 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-4becc793-726b-41aa-9003-3f916fedb2ba admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:52.947069 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-4becc793-726b-41aa-9003-3f916fedb2ba admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001463 Jun 06 13:00:52.947475 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 13/27] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:00:52 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:00:53.006301 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-453a5d19-fa2c-41e6-ba79-0bd29d0ae569 admin admin] Action: 'create', calling method: >, body: {"flavor": {"id": "3", "swap": 0, "disk": 40, "ram": 4096, "os-flavor-access:is_public": true, "vcpus": 2, "name": "m1.medium", "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:53.079736 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-453a5d19-fa2c-41e6-ba79-0bd29d0ae569 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.126479 Jun 06 13:00:53.080322 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 15/28] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 13:00:52 2022] POST /compute/v2.1/flavors => generated 406 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:00:53.092281 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-43eed724-8bff-49db-b6bd-3b9bbdf8ee1c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:53.168732 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-43eed724-8bff-49db-b6bd-3b9bbdf8ee1c admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079963 Jun 06 13:00:53.169298 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 14/29] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 6 13:00:53 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:00:55.485327 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-453a5d19-fa2c-41e6-ba79-0bd29d0ae569 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:55.486319 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-453a5d19-fa2c-41e6-ba79-0bd29d0ae569 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001426 Jun 06 13:00:55.486714 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 16/30] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:00:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:00:55.544924 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-3de4dab4-7436-47e7-96f3-ef1d0f501a82 admin admin] Action: 'create', calling method: >, body: {"flavor": {"swap": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "ram": 8192, "vcpus": 4, "name": "m1.large", "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "4"}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:55.618059 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-3de4dab4-7436-47e7-96f3-ef1d0f501a82 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.124585 Jun 06 13:00:55.618617 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 15/31] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 13:00:55 2022] POST /compute/v2.1/flavors => generated 405 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 13:00:55.630534 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-e187cdf4-79b0-4d95-a602-bf3b7fae1b69 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:55.725185 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-e187cdf4-79b0-4d95-a602-bf3b7fae1b69 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.098321 Jun 06 13:00:55.725774 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 17/32] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 6 13:00:55 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:00:58.090906 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-3de4dab4-7436-47e7-96f3-ef1d0f501a82 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:00:58.092675 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-3de4dab4-7436-47e7-96f3-ef1d0f501a82 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002197 Jun 06 13:00:58.093075 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 16/33] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:00:58 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:00:58.155658 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-184f1d2e-a927-4f6c-9396-574c157fc653 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 160, "ram": 16384, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "5", "swap": 0, "name": "m1.xlarge", "os-flavor-access:is_public": true, "vcpus": 8, "rxtx_factor": 1.0}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:58.217063 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-184f1d2e-a927-4f6c-9396-574c157fc653 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.117240 Jun 06 13:00:58.217551 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 18/34] 10.222.0.13 () {64 vars in 1282 bytes} [Mon Jun 6 13:00:58 2022] POST /compute/v2.1/flavors => generated 408 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:00:58.229725 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-16853f7f-bbf9-458c-b003-abbe56b249b6 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:00:58.305933 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-16853f7f-bbf9-458c-b003-abbe56b249b6 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.079947 Jun 06 13:00:58.306909 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 17/35] 10.222.0.13 () {64 vars in 1332 bytes} [Mon Jun 6 13:00:58 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:01:22.436130 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-184f1d2e-a927-4f6c-9396-574c157fc653 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:22.437152 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-184f1d2e-a927-4f6c-9396-574c157fc653 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001510 Jun 06 13:01:22.437549 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 19/36] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:01:22 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:01:22.448381 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_api:SELECT=47,nova_api:INSERT=10,nova_api:SAVEPOINT=5,nova_api:RELEASE=5 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:01:22.497115 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-ae27e991-7cd5-4e19-a9a2-101ceb06ca4a admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:22.516529 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-ae27e991-7cd5-4e19-a9a2-101ceb06ca4a admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.072643 Jun 06 13:01:22.517069 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 18/37] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jun 6 13:01:22 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:01:23.508982 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-184f1d2e-a927-4f6c-9396-574c157fc653 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:23.509971 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-184f1d2e-a927-4f6c-9396-574c157fc653 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001400 Jun 06 13:01:23.510370 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 20/38] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 13:01:23 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:01:23.715952 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-e70909c3-9916-4802-84fc-0398dbb5d986 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:23.721408 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.wsgi [None req-e70909c3-9916-4802-84fc-0398dbb5d986 admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-e70909c3-9916-4802-84fc-0398dbb5d986 admin admin] Request method failure captured: Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Accept: application/json Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Accept-Encoding: gzip, deflate Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Connection: keep-alive Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Content-Length: 0 Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Host: 10.222.0.13 Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Openstack-Api-Version: compute 2.90 Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Openstack-System-Scope: None Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: User-Agent: python-novaclient Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Auth-Token: gAAAAABinfqjtTPoGwyIsiMOPqMkKxieubR0AeJ_6XQyHxOnR7xSEOFYAvpvVUhhW_nWO0OAOS9Ot2etYWZKvLfe3LrhREn97ODW2o9gcUFGGJjb2f-3_1CGT59tv6EPHlbIpzPxe0TK6_o3YUACyRIW49POwQKe9q-VK5w92GwjMU-BAjPF9rE Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Domain-Id: None Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Domain-Name: None Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Identity-Status: Confirmed Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Is-Admin-Project: True Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Project-Domain-Id: default Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Project-Domain-Name: Default Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Project-Id: 16ba10bd5fa94006bd8ba1520b916555 Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Project-Name: admin Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Role: member,admin,reader Jun 06 13:01:23.725321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Roles: member,admin,reader Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_16ba10bd5fa94006bd8ba1520b916555", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/16ba10bd5fa94006bd8ba1520b916555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/16ba10bd5fa94006bd8ba1520b916555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/16ba10bd5fa94006bd8ba1520b916555"}]}] Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Tenant: admin Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Tenant-Id: 16ba10bd5fa94006bd8ba1520b916555 Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Tenant-Name: admin Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User: admin Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User-Domain-Id: default Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User-Domain-Name: Default Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User-Id: 1492cd2eb7c64ad8959375e22df26ab7 Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User-Name: admin Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: method: > Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: exception: Flavor 42 could not be found. Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: action_args: {'id': '42'} Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:01:23.727134 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:01:23.728260 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:23.729493 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-e70909c3-9916-4802-84fc-0398dbb5d986 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:01:23.730545 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-e70909c3-9916-4802-84fc-0398dbb5d986 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.060907 Jun 06 13:01:23.730545 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 19/39] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jun 6 13:01:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:23.736252 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-e46d1a41-8767-44f9-9e40-b58d1e003599 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:23.739195 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_api:SELECT=47,nova_api:SAVEPOINT=5,nova_api:INSERT=10,nova_api:RELEASE=5 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:01:23.757613 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-e46d1a41-8767-44f9-9e40-b58d1e003599 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.024860 Jun 06 13:01:23.758144 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 21/40] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 6 13:01:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 26 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:01:23.778943 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-5188ac77-64ba-4fff-89c5-dd1468f0357c admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:23.801486 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-5188ac77-64ba-4fff-89c5-dd1468f0357c admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.025974 Jun 06 13:01:23.802141 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 20/41] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 6 13:01:23 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:01:23.811819 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-53cdd2e3-4687-462c-a46b-45ba4fc73f0f admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:23.818065 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.wsgi [None req-53cdd2e3-4687-462c-a46b-45ba4fc73f0f admin admin] HTTP exception thrown: Flavor 42 could not be found. Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-53cdd2e3-4687-462c-a46b-45ba4fc73f0f admin admin] Request method failure captured: Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Accept: application/json Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Accept-Encoding: gzip, deflate Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Connection: keep-alive Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Content-Length: 0 Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Host: 10.222.0.13 Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Openstack-Api-Version: compute 2.90 Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Openstack-System-Scope: None Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: User-Agent: python-novaclient Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Auth-Token: gAAAAABinfqjtTPoGwyIsiMOPqMkKxieubR0AeJ_6XQyHxOnR7xSEOFYAvpvVUhhW_nWO0OAOS9Ot2etYWZKvLfe3LrhREn97ODW2o9gcUFGGJjb2f-3_1CGT59tv6EPHlbIpzPxe0TK6_o3YUACyRIW49POwQKe9q-VK5w92GwjMU-BAjPF9rE Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Domain-Id: None Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Domain-Name: None Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Identity-Status: Confirmed Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Is-Admin-Project: True Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Project-Domain-Id: default Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Project-Domain-Name: Default Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Project-Id: 16ba10bd5fa94006bd8ba1520b916555 Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Project-Name: admin Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Role: member,admin,reader Jun 06 13:01:23.821447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Roles: member,admin,reader Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_16ba10bd5fa94006bd8ba1520b916555", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/16ba10bd5fa94006bd8ba1520b916555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/16ba10bd5fa94006bd8ba1520b916555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/16ba10bd5fa94006bd8ba1520b916555"}]}] Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Tenant: admin Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Tenant-Id: 16ba10bd5fa94006bd8ba1520b916555 Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Tenant-Name: admin Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User: admin Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User-Domain-Id: default Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User-Domain-Name: Default Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User-Id: 1492cd2eb7c64ad8959375e22df26ab7 Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User-Name: admin Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: method: > Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: exception: Flavor 42 could not be found. Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: action_args: {'id': '42'} Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:01:23.826976 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:01:23.828016 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:23.829420 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-53cdd2e3-4687-462c-a46b-45ba4fc73f0f admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=103686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:01:23.830726 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-53cdd2e3-4687-462c-a46b-45ba4fc73f0f admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.90 time: 0.014624 Jun 06 13:01:23.830726 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 22/42] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jun 6 13:01:23 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 16 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:24.685429 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-5188ac77-64ba-4fff-89c5-dd1468f0357c admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:24.686378 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-5188ac77-64ba-4fff-89c5-dd1468f0357c admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001429 Jun 06 13:01:24.686767 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 21/43] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 13:01:24 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:01:24.873067 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-0b2d342d-0e8d-4373-bba4-5571bd682f40 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:24.878305 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.wsgi [None req-0b2d342d-0e8d-4373-bba4-5571bd682f40 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-0b2d342d-0e8d-4373-bba4-5571bd682f40 admin admin] Request method failure captured: Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Accept: application/json Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Accept-Encoding: gzip, deflate Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Connection: keep-alive Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Content-Length: 0 Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Host: 10.222.0.13 Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Openstack-Api-Version: compute 2.90 Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Openstack-System-Scope: None Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: User-Agent: python-novaclient Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Auth-Token: gAAAAABinfqkCvyEi3OF9q47C5KZsZLx5v65wfAEjt4e_K1vqlgNAjs8px7dPSDRn-4QQEYZRfZsJq40s4wqJUeXIX1wDEsQNkHdTC30pPdzNxozu47-Zn9elqUZ5XFocjA06UKS3brSLH56tIRuZb4KIfX63ZTO3LNuUUUD0nqQWdmNFtzs-4M Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Domain-Id: None Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Domain-Name: None Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Identity-Status: Confirmed Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Is-Admin-Project: True Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Project-Domain-Id: default Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Project-Domain-Name: Default Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Project-Id: 16ba10bd5fa94006bd8ba1520b916555 Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Project-Name: admin Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Role: member,admin,reader Jun 06 13:01:24.880234 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Roles: member,admin,reader Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_16ba10bd5fa94006bd8ba1520b916555", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/16ba10bd5fa94006bd8ba1520b916555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/16ba10bd5fa94006bd8ba1520b916555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/16ba10bd5fa94006bd8ba1520b916555"}]}] Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Tenant: admin Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Tenant-Id: 16ba10bd5fa94006bd8ba1520b916555 Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Tenant-Name: admin Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User: admin Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User-Domain-Id: default Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User-Domain-Name: Default Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User-Id: 1492cd2eb7c64ad8959375e22df26ab7 Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User-Name: admin Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: method: > Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: exception: Flavor 84 could not be found. Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: action_args: {'id': '84'} Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:01:24.881585 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:01:24.882721 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:24.884231 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-0b2d342d-0e8d-4373-bba4-5571bd682f40 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:01:24.885529 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-0b2d342d-0e8d-4373-bba4-5571bd682f40 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.061031 Jun 06 13:01:24.885529 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 23/44] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jun 6 13:01:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 62 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:24.891259 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-906666dd-1f41-400f-a687-fa35031ea2e3 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:24.905884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-906666dd-1f41-400f-a687-fa35031ea2e3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018145 Jun 06 13:01:24.906449 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 22/45] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 6 13:01:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:01:24.916571 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-1f282fa2-d1b7-497d-b805-603ba973ab93 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:24.931241 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-1f282fa2-d1b7-497d-b805-603ba973ab93 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018160 Jun 06 13:01:24.931800 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 24/46] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 6 13:01:24 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:01:24.940983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-382365e2-82af-484b-81c3-41acf09398e4 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:24.946576 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.wsgi [None req-382365e2-82af-484b-81c3-41acf09398e4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-382365e2-82af-484b-81c3-41acf09398e4 admin admin] Request method failure captured: Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Accept: application/json Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Accept-Encoding: gzip, deflate Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Connection: keep-alive Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Content-Length: 0 Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Host: 10.222.0.13 Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Openstack-Api-Version: compute 2.90 Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Openstack-System-Scope: None Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: User-Agent: python-novaclient Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Auth-Token: gAAAAABinfqkCvyEi3OF9q47C5KZsZLx5v65wfAEjt4e_K1vqlgNAjs8px7dPSDRn-4QQEYZRfZsJq40s4wqJUeXIX1wDEsQNkHdTC30pPdzNxozu47-Zn9elqUZ5XFocjA06UKS3brSLH56tIRuZb4KIfX63ZTO3LNuUUUD0nqQWdmNFtzs-4M Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Domain-Id: None Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Domain-Name: None Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Identity-Status: Confirmed Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Is-Admin-Project: True Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Project-Domain-Id: default Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Project-Domain-Name: Default Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Project-Id: 16ba10bd5fa94006bd8ba1520b916555 Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Project-Name: admin Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Role: member,admin,reader Jun 06 13:01:24.948926 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Roles: member,admin,reader Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_16ba10bd5fa94006bd8ba1520b916555", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/16ba10bd5fa94006bd8ba1520b916555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/16ba10bd5fa94006bd8ba1520b916555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/16ba10bd5fa94006bd8ba1520b916555"}]}] Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Tenant: admin Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Tenant-Id: 16ba10bd5fa94006bd8ba1520b916555 Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Tenant-Name: admin Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User: admin Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User-Domain-Id: default Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User-Domain-Name: Default Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User-Id: 1492cd2eb7c64ad8959375e22df26ab7 Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User-Name: admin Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: method: > Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: exception: Flavor 84 could not be found. Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: action_args: {'id': '84'} Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:01:24.950650 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:01:24.951721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:24.953125 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-382365e2-82af-484b-81c3-41acf09398e4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=103687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:01:24.954405 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-382365e2-82af-484b-81c3-41acf09398e4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.90 time: 0.013484 Jun 06 13:01:24.954405 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 23/47] 10.222.0.13 () {60 vars in 1190 bytes} [Mon Jun 6 13:01:24 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:25.811462 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-1f282fa2-d1b7-497d-b805-603ba973ab93 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:25.812490 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-1f282fa2-d1b7-497d-b805-603ba973ab93 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Jun 06 13:01:25.812891 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 25/48] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 13:01:25 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:01:26.000174 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-3e0d247c-4f7e-400c-82fa-ff748db21b1e admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:26.005515 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.wsgi [None req-3e0d247c-4f7e-400c-82fa-ff748db21b1e admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-3e0d247c-4f7e-400c-82fa-ff748db21b1e admin admin] Request method failure captured: Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Accept: application/json Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Accept-Encoding: gzip, deflate Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Connection: keep-alive Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Content-Length: 0 Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Host: 10.222.0.13 Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Openstack-Api-Version: compute 2.90 Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Openstack-System-Scope: None Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: User-Agent: python-novaclient Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Auth-Token: gAAAAABinfqlpIih1PrBdr8xBZWRNicaylIb1_pPkb3QPwbkj43PwYKRug9XzyV1m8ql8M97y602BbIga7GvumhHiq3ZbEVzV7nv9hFuA02hWfUQWVZm13-ralrg5jkWUev5Y1QKS9lwJzjCok6jOjvvcLSRizQ5t2xEcG3GPZZxKlKOLf_Qa2s Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Domain-Id: None Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Domain-Name: None Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Identity-Status: Confirmed Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Is-Admin-Project: True Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Project-Domain-Id: default Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Project-Domain-Name: Default Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Project-Id: 16ba10bd5fa94006bd8ba1520b916555 Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Project-Name: admin Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Role: member,admin,reader Jun 06 13:01:26.006983 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Roles: member,admin,reader Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_16ba10bd5fa94006bd8ba1520b916555", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/16ba10bd5fa94006bd8ba1520b916555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/16ba10bd5fa94006bd8ba1520b916555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/16ba10bd5fa94006bd8ba1520b916555"}]}] Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Tenant: admin Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Tenant-Id: 16ba10bd5fa94006bd8ba1520b916555 Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-Tenant-Name: admin Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User: admin Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User-Domain-Id: default Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User-Domain-Name: Default Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User-Id: 1492cd2eb7c64ad8959375e22df26ab7 Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: X-User-Name: admin Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: method: > Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: exception: Flavor 451 could not be found. Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: action_args: {'id': '451'} Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:01:26.008535 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:01:26.009510 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: ERROR nova.api.openstack.wsgi Jun 06 13:01:26.010884 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-3e0d247c-4f7e-400c-82fa-ff748db21b1e admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103687) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:01:26.012194 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-3e0d247c-4f7e-400c-82fa-ff748db21b1e admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.059692 Jun 06 13:01:26.012194 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 24/49] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 6 13:01:25 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 61 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:26.018045 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-a76b744d-048f-4b7c-a1de-0e9bd3b4caba admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:26.032671 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-a76b744d-048f-4b7c-a1de-0e9bd3b4caba admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.018128 Jun 06 13:01:26.033139 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 26/50] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 6 13:01:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:01:26.043431 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:26.056662 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.90 time: 0.017127 Jun 06 13:01:26.057195 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 25/51] 10.222.0.13 () {60 vars in 1210 bytes} [Mon Jun 6 13:01:26 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 18 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:01:26.066211 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-7dcea4a1-a302-4c24-8759-5b6c225ddf42 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:26.071809 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.wsgi [None req-7dcea4a1-a302-4c24-8759-5b6c225ddf42 admin admin] HTTP exception thrown: Flavor 451 could not be found. Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-7dcea4a1-a302-4c24-8759-5b6c225ddf42 admin admin] Request method failure captured: Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Accept: application/json Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Accept-Encoding: gzip, deflate Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Connection: keep-alive Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Content-Length: 0 Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Host: 10.222.0.13 Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Openstack-Api-Version: compute 2.90 Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Openstack-System-Scope: None Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: User-Agent: python-novaclient Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Auth-Token: gAAAAABinfqlpIih1PrBdr8xBZWRNicaylIb1_pPkb3QPwbkj43PwYKRug9XzyV1m8ql8M97y602BbIga7GvumhHiq3ZbEVzV7nv9hFuA02hWfUQWVZm13-ralrg5jkWUev5Y1QKS9lwJzjCok6jOjvvcLSRizQ5t2xEcG3GPZZxKlKOLf_Qa2s Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Domain-Id: None Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Domain-Name: None Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Identity-Status: Confirmed Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Is-Admin-Project: True Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Openstack-Nova-Api-Version: 2.90 Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Project-Domain-Id: default Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Project-Domain-Name: Default Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Project-Id: 16ba10bd5fa94006bd8ba1520b916555 Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Project-Name: admin Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Role: member,admin,reader Jun 06 13:01:26.073288 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Roles: member,admin,reader Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_16ba10bd5fa94006bd8ba1520b916555", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/16ba10bd5fa94006bd8ba1520b916555"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/16ba10bd5fa94006bd8ba1520b916555"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/16ba10bd5fa94006bd8ba1520b916555"}]}] Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Tenant: admin Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Tenant-Id: 16ba10bd5fa94006bd8ba1520b916555 Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-Tenant-Name: admin Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User: admin Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User-Domain-Id: default Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User-Domain-Name: Default Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User-Id: 1492cd2eb7c64ad8959375e22df26ab7 Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: X-User-Name: admin Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: method: > Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: exception: Flavor 451 could not be found. Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: action_args: {'id': '451'} Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:01:26.074578 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:01:26.075405 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: ERROR nova.api.openstack.wsgi Jun 06 13:01:26.076707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-7dcea4a1-a302-4c24-8759-5b6c225ddf42 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=103686) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:01:26.077966 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-7dcea4a1-a302-4c24-8759-5b6c225ddf42 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.90 time: 0.011930 Jun 06 13:01:26.077966 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 27/52] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 6 13:01:26 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 13 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Jun 06 13:01:26.939479 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:26.940529 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001486 Jun 06 13:01:26.940932 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 26/53] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 13:01:26 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:01:27.133565 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-6f310836-174a-4269-86c1-95abf7dedf3f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:01:27.210031 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-6f310836-174a-4269-86c1-95abf7dedf3f admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.90 time: 0.129091 Jun 06 13:01:27.210583 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 28/54] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jun 6 13:01:27 2022] POST /compute/v2.1/flavors => generated 404 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:01:28.085923 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:28.086917 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001398 Jun 06 13:01:28.087327 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 27/55] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 13:01:28 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:01:28.280466 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-3b21bca7-fc40-450f-a2dd-512c5f8e2ef5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:01:28.386239 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-3b21bca7-fc40-450f-a2dd-512c5f8e2ef5 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.90 time: 0.157045 Jun 06 13:01:28.386792 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 29/56] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jun 6 13:01:28 2022] POST /compute/v2.1/flavors => generated 405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 13:01:29.265548 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:29.266545 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001405 Jun 06 13:01:29.266945 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 28/57] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 13:01:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:01:29.456302 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-262bf7b1-a505-4b0d-8344-c8ac61d9d718 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:01:29.546700 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-262bf7b1-a505-4b0d-8344-c8ac61d9d718 admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.90 time: 0.143196 Jun 06 13:01:29.547189 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 30/58] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jun 6 13:01:29 2022] POST /compute/v2.1/flavors => generated 407 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:01:30.411912 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:30.412921 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001453 Jun 06 13:01:30.413354 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 29/59] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 13:01:30 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:01:30.604533 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-485405a4-339f-4950-ae30-aaae8327ee5a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:01:30.683334 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-485405a4-339f-4950-ae30-aaae8327ee5a admin admin] 10.222.0.13 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.90 time: 0.133554 Jun 06 13:01:30.683918 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 31/60] 10.222.0.13 () {64 vars in 1235 bytes} [Mon Jun 6 13:01:30 2022] POST /compute/v2.1/flavors => generated 409 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:01:31.545310 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:31.546308 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Jun 06 13:01:31.546703 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 30/61] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 13:01:31 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:01:31.736257 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-2622e6f1-22c0-4123-93f9-dd8d1663e2b6 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:01:31.756642 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-2622e6f1-22c0-4123-93f9-dd8d1663e2b6 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.90 time: 0.071455 Jun 06 13:01:31.757122 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 32/62] 10.222.0.13 () {60 vars in 1202 bytes} [Mon Jun 6 13:01:31 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:02:34.555682 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:02:34.556749 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-e5ebca26-7b44-4da4-86b7-7960807ebc53 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001567 Jun 06 13:02:34.557198 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 31/63] 10.222.0.13 () {54 vars in 930 bytes} [Mon Jun 6 13:02:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:02:34.564810 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_api:SELECT=26,nova_api:INSERT=4 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:02:34.617311 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-7379ef64-74e7-4fa7-ada4-6d349cba59c4 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:02:34.637052 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-7379ef64-74e7-4fa7-ada4-6d349cba59c4 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.073808 Jun 06 13:02:34.637597 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 33/64] 10.222.0.13 () {60 vars in 1291 bytes} [Mon Jun 6 13:02:34 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:02:34.658780 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG dbcounter [-] [103687] Writing DB stats nova_api:SELECT=14 {{(pid=103687) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:02:34.662414 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-6da7cfa5-5d90-4097-99e1-5037ddc3eca3 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:02:34.669870 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-6da7cfa5-5d90-4097-99e1-5037ddc3eca3 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.013160 Jun 06 13:02:34.670692 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 32/65] 10.222.0.13 () {60 vars in 1282 bytes} [Mon Jun 6 13:02:34 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:02:34.682312 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-44b26075-dbee-44ab-a599-308840298c51 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:02:34.690430 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-44b26075-dbee-44ab-a599-308840298c51 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011641 Jun 06 13:02:34.690946 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 34/66] 10.222.0.13 () {60 vars in 1285 bytes} [Mon Jun 6 13:02:34 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:02:34.702385 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-89b39cfa-a0a1-4fe1-8543-eddbdfbabb32 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:02:34.710536 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-89b39cfa-a0a1-4fe1-8543-eddbdfbabb32 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.011976 Jun 06 13:02:34.711052 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 33/67] 10.222.0.13 () {60 vars in 1285 bytes} [Mon Jun 6 13:02:34 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 13 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:02:34.724115 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-b1cd8554-2f63-4694-983c-717ad465dd61 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:02:34.732924 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-b1cd8554-2f63-4694-983c-717ad465dd61 admin admin] 10.222.0.13 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.014292 Jun 06 13:02:34.733797 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 35/68] 10.222.0.13 () {60 vars in 1282 bytes} [Mon Jun 6 13:02:34 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 16 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:06:20.449835 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-89b39cfa-a0a1-4fe1-8543-eddbdfbabb32 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:06:20.451721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-89b39cfa-a0a1-4fe1-8543-eddbdfbabb32 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001441 Jun 06 13:06:20.451721 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 34/69] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 13:06:20 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:06:20.612447 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_api:SELECT=6 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:06:20.725491 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-e027c0cc-9574-40ce-882d-48f1ad32a79c admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:06:20.726862 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:06:20.726862 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: warnings.warn(msg) Jun 06 13:06:20.728097 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-e027c0cc-9574-40ce-882d-48f1ad32a79c admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:06:20.728538 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-e027c0cc-9574-40ce-882d-48f1ad32a79c admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:06:20.729322 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-e027c0cc-9574-40ce-882d-48f1ad32a79c admin admin] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:06:20.729749 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-e027c0cc-9574-40ce-882d-48f1ad32a79c admin admin] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:06:20.763707 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-e027c0cc-9574-40ce-882d-48f1ad32a79c admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.153203 Jun 06 13:06:20.764268 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 36/70] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 6 13:06:20 2022] GET /compute/v2.1/os-services => generated 794 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:06:21.643869 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-89b39cfa-a0a1-4fe1-8543-eddbdfbabb32 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:06:21.644962 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-89b39cfa-a0a1-4fe1-8543-eddbdfbabb32 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001547 Jun 06 13:06:21.645364 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 35/71] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 13:06:21 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:06:21.841810 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-7438f528-b4de-401e-bdf6-82a9e139ef4b admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:06:21.842975 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:06:21.842975 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: warnings.warn(msg) Jun 06 13:06:21.844251 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-7438f528-b4de-401e-bdf6-82a9e139ef4b admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:06:21.844687 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-7438f528-b4de-401e-bdf6-82a9e139ef4b admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:06:21.845501 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-7438f528-b4de-401e-bdf6-82a9e139ef4b admin admin] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:06:21.845924 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-7438f528-b4de-401e-bdf6-82a9e139ef4b admin admin] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:06:21.865784 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-7438f528-b4de-401e-bdf6-82a9e139ef4b admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.90 time: 0.076682 Jun 06 13:06:21.866341 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 37/72] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 6 13:06:21 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:06:33.158914 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-89b39cfa-a0a1-4fe1-8543-eddbdfbabb32 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:06:33.159895 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-89b39cfa-a0a1-4fe1-8543-eddbdfbabb32 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001421 Jun 06 13:06:33.160321 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 36/73] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 13:06:33 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:06:33.302391 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_cell0:SELECT=4 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:06:33.303108 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_cell1:SELECT=4 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:06:33.303750 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG dbcounter [-] [103686] Writing DB stats nova_api:SELECT=8 {{(pid=103686) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:06:33.353871 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-acc50143-07b8-403c-896e-1e98eb1db21e admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:06:33.355050 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:06:33.355050 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: warnings.warn(msg) Jun 06 13:06:33.356293 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-acc50143-07b8-403c-896e-1e98eb1db21e admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:06:33.356737 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-acc50143-07b8-403c-896e-1e98eb1db21e admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:06:33.357532 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-acc50143-07b8-403c-896e-1e98eb1db21e admin admin] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:06:33.357964 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-acc50143-07b8-403c-896e-1e98eb1db21e admin admin] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:06:33.386047 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-acc50143-07b8-403c-896e-1e98eb1db21e admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.088059 Jun 06 13:06:33.386619 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 38/74] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 6 13:06:33 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:06:34.276053 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: DEBUG nova.api.openstack.wsgi [None req-89b39cfa-a0a1-4fe1-8543-eddbdfbabb32 admin admin] Calling method '>' {{(pid=103687) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:06:34.277044 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: INFO nova.api.openstack.requestlog [None req-89b39cfa-a0a1-4fe1-8543-eddbdfbabb32 admin admin] 10.222.0.13 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001446 Jun 06 13:06:34.277441 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: [pid: 103687|app: 0|req: 37/75] 10.222.0.13 () {56 vars in 1074 bytes} [Mon Jun 6 13:06:34 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:06:34.465478 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG nova.api.openstack.wsgi [None req-36108bcd-ddcb-403e-83f4-3f6302dac762 admin admin] Calling method '>' {{(pid=103686) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:06:34.467613 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: /usr/local/lib/python3.8/dist-packages/oslo_policy/policy.py:1129: UserWarning: Policy "os_compute_api:os-services:list": "rule:context_is_admin" failed scope check. The token used to make the request was project scoped but the policy requires ['system'] scope. This behavior may change in the future where using the intended scope is required Jun 06 13:06:34.467613 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: warnings.warn(msg) Jun 06 13:06:34.468168 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-36108bcd-ddcb-403e-83f4-3f6302dac762 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:06:34.468622 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-36108bcd-ddcb-403e-83f4-3f6302dac762 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:06:34.469409 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-36108bcd-ddcb-403e-83f4-3f6302dac762 admin admin] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:06:34.469843 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: DEBUG oslo_concurrency.lockutils [None req-36108bcd-ddcb-403e-83f4-3f6302dac762 admin admin] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=103686) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:06:34.492477 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: INFO nova.api.openstack.requestlog [None req-36108bcd-ddcb-403e-83f4-3f6302dac762 admin admin] 10.222.0.13 "GET /compute/v2.1/os-services" status: 200 len: 1038 microversion: 2.90 time: 0.079311 Jun 06 13:06:34.492970 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: [pid: 103686|app: 0|req: 39/76] 10.222.0.13 () {60 vars in 1193 bytes} [Mon Jun 6 13:06:34 2022] GET /compute/v2.1/os-services => generated 1038 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:07:30.979639 dv-cinder-755101-10-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Jun 06 13:07:30.980208 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: Mon Jun 6 13:07:30 2022 - graceful shutdown triggered... Jun 06 13:07:30.980675 dv-cinder-755101-10-iscsi devstack@n-api.service[103686]: Gracefully killing worker 1 (pid: 103686)... Jun 06 13:07:30.981037 dv-cinder-755101-10-iscsi devstack@n-api.service[103687]: Gracefully killing worker 2 (pid: 103687)... Jun 06 13:07:31.981336 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: worker 1 buried after 1 seconds Jun 06 13:07:31.981336 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: worker 2 buried after 1 seconds Jun 06 13:07:31.981896 dv-cinder-755101-10-iscsi devstack@n-api.service[103685]: goodbye to uWSGI. Jun 06 13:07:31.982933 dv-cinder-755101-10-iscsi systemd[1]: devstack@n-api.service: Succeeded. Jun 06 13:07:31.983498 dv-cinder-755101-10-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Jun 06 13:07:31.986178 dv-cinder-755101-10-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Jun 06 13:07:32.004289 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: *** Starting uWSGI 2.0.18-debian (64bit) on [Mon Jun 6 13:07:32 2022] *** Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: nodename: dv-cinder-755101-10-iscsi Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: machine: x86_64 Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: clock source: unix Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: pcre jit disabled Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: detected number of CPU cores: 4 Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: current working directory: / Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: detected binary path: /usr/bin/uwsgi-core Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: your processes number limit is 47680 Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: your memory page size is 4096 bytes Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: detected max file descriptor number: 2048 Jun 06 13:07:32.021236 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: lock engine: pthread robust mutexes Jun 06 13:07:32.022452 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: thunder lock: enabled Jun 06 13:07:32.022452 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Jun 06 13:07:32.022452 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: Python version: 3.8.10 (default, Mar 15 2022, 12:22:08) [GCC 9.4.0] Jun 06 13:07:32.066747 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: Python main interpreter initialized at 0x55abc3e379c0 Jun 06 13:07:32.066747 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: python threads support enabled Jun 06 13:07:32.066747 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: your server socket listen backlog is limited to 100 connections Jun 06 13:07:32.066747 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: your mercy for graceful operations on workers is 90 seconds Jun 06 13:07:32.067157 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: mapped 403077 bytes (393 KB) for 2 cores Jun 06 13:07:32.067157 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: *** Operational MODE: preforking *** Jun 06 13:07:32.067359 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: *** uWSGI is running in multiple interpreter mode *** Jun 06 13:07:32.067359 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: spawned uWSGI master process (pid: 118120) Jun 06 13:07:32.067579 dv-cinder-755101-10-iscsi systemd[1]: Started Devstack devstack@n-api.service. Jun 06 13:07:32.068276 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: spawned uWSGI worker 1 (pid: 118133, cores: 1) Jun 06 13:07:32.068643 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: spawned uWSGI worker 2 (pid: 118134, cores: 1) Jun 06 13:07:32.068817 dv-cinder-755101-10-iscsi devstack@n-api.service[118120]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Jun 06 13:07:33.320196 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 13:07:33.320789 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Jun 06 13:07:34.151925 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 13:07:34.151925 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: from cryptography.utils import int_from_bytes Jun 06 13:07:34.152260 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 13:07:34.152260 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: from cryptography.utils import int_from_bytes Jun 06 13:07:34.152403 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 13:07:34.152403 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: from cryptography.utils import int_from_bytes Jun 06 13:07:34.152572 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Jun 06 13:07:34.152572 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: from cryptography.utils import int_from_bytes Jun 06 13:07:36.515513 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 13:07:36.516215 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 13:07:36.516328 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 13:07:36.516644 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 13:07:36.516945 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 13:07:36.517281 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.517604 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.517922 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.518238 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.519469 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.519821 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.520135 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.520456 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.520786 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.521045 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.521358 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.521683 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-755101-10-iscsi {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.522010 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.522318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.522626 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.522942 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.523246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.523593 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.523910 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.524404 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.525550 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.525550 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.525550 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.525785 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.526054 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.526359 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.526676 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.526983 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.527304 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.527640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.527844 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Jun 06 13:07:36.528363 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-755101-10-iscsi {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.528571 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Jun 06 13:07:36.528775 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.528978 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Jun 06 13:07:36.529182 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.529182 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.529568 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Jun 06 13:07:36.529568 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Jun 06 13:07:36.529958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.530164 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.530355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.530544 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.530733 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.530939 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.531136 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.531338 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.531515 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.531687 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.531871 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.532013 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.532188 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.532331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.532471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.532611 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.532744 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.532902 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.533051 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.533193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.533327 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.533470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.533614 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.533747 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-755101-10-iscsi {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.533905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.534047 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.534242 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.534992 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.535213 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.535406 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.535575 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.535725 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.535867 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.536003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.536135 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.536285 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.536430 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.536571 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.536725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.536725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.537197 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.537356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.537504 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.537644 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.537779 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.537920 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.538068 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.538211 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.538345 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.538484 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.538627 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.538769 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.538912 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.539053 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.539187 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.539332 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.539465 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.539645 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.539863 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.540007 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.540149 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.540285 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.540285 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.540551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-755101-10-iscsi {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.540691 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.540832 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.540971 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.541111 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.541260 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.541405 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.541546 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.541686 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.541820 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.542533 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.542690 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.542832 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.542976 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.543110 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.543243 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.543387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.543579 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.543717 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.543850 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.544003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.544138 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.544284 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.544419 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.544551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.544695 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.544835 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.544968 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.545109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.545250 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.545392 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.545533 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.545675 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.545818 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.545961 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.546103 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.546236 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.546368 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.546500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.546639 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.546785 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.546927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.547073 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.547293 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.547439 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.547611 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.547747 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.547880 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.548012 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.548154 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.548287 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.548435 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.548569 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.548703 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.548835 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.548975 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.549118 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.549252 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.549384 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.549523 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.549665 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.549853 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.550090 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.550317 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.550550 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.550698 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.550830 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.550973 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.551122 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.551264 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.551402 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.551611 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.551750 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.551893 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.552037 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.552172 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.552303 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.552441 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.552587 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.552812 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.552949 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.553082 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.553214 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.553355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.553496 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.13 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.553640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.553773 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.13 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.553913 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.554060 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.554201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.554334 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.554475 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.554615 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.554749 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.554896 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.555030 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.555162 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.555294 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.555425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.555599 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.555745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.555887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.556028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.556162 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.556305 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.556444 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.556591 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.556724 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.556856 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.557000 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.557140 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.557309 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.557444 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.557576 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.557708 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.557847 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.557980 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.558127 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.558260 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.558391 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.558523 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.558663 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.558795 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.558941 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.559083 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.559222 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.559355 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.559512 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.559804 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.559955 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.560099 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.560233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.560365 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.560496 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.560642 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.560785 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.560925 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.561074 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.561518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.561659 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.561809 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.561944 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.562085 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.562219 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.562351 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.562491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.562633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.562767 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.562906 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.563047 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.563190 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.563325 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.563471 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.563633 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.563780 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.563922 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.564065 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.564207 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.564341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.564480 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.564622 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.564622 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.564889 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.565023 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.565161 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.565302 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.565453 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.565647 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.565841 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.566058 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.566298 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.566442 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.566660 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.566798 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.566931 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.567071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.567205 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.567337 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.567469 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.567620 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.567766 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.567908 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.568041 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.568187 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.568330 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.568469 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.568611 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.568744 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.568875 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.569020 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.569160 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.569292 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.569425 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.569566 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.569709 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.569851 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.569985 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.570117 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.570255 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.570393 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.570526 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.570669 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.570809 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.570951 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.571092 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.571233 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.571384 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.571593 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.571748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.571889 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.572023 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.572162 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Jun 06 13:07:36.572296 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.572428 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.572569 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.572704 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.572836 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.572975 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.573116 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.573279 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.573460 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.573593 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.573725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.573855 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.573994 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.574135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.574266 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.574395 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.574525 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.574655 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.574794 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.574939 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.575078 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.575265 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.575408 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.575570 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.576251 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.576407 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.576549 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.576683 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.576823 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.576965 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.577118 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.577252 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.577385 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.577529 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.577688 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.577852 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.578002 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.578145 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.578290 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.578431 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.578564 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.578703 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.578846 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.578988 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.579121 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.579253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.579384 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.579600 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.579762 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.579897 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.580031 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.580163 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.580303 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.580451 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.580585 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.580717 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.580857 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.581485 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.581662 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.581892 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.582127 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.582310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.582454 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.582595 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.582738 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.582738 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.583001 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.583134 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.583276 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.583276 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.583574 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.583574 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.583851 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.583993 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.584126 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.584267 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.584409 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.584543 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.584682 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.584815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.584957 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.585090 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.585232 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.585365 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.585504 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.585640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.585779 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.585913 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.586058 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.586199 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.586333 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.586333 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.586583 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.586722 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.586869 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.587011 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.587145 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.587284 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.587426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.587591 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.587738 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.587879 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.588002 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.588132 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.588264 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.588405 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.588548 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.588681 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.588813 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.588953 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.589086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.589232 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.589373 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.589508 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.589640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.589640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.589897 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.590045 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.590178 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.590294 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.590433 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.590567 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.590712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.590846 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.590986 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.591127 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.591260 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.591400 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.591644 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.591789 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.591930 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.592063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.592195 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.592336 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.592479 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.592614 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.592754 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.592887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.593027 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.593027 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.593295 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.593435 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.593569 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.593702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.593834 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.593976 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.594120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.594260 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.594400 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.594540 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.594687 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.594835 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.594969 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.595109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.595250 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.595390 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.595563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.595716 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.595859 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.596000 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.596140 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.596273 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.596406 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.596548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.597255 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.597503 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.597730 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.597965 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.598121 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.598264 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.598404 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.598537 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.598670 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.598810 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.598956 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.599098 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.599233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.599372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.599513 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.599679 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.599827 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.599964 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.600139 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.600276 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.600444 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.600581 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.600758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.600903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.601069 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.601207 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.601380 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.601528 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.601671 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.601805 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.601984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.602127 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.602298 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.602447 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.602588 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.602722 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.602889 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.603034 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.603191 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.603342 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.603512 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.603685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.603821 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.603953 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.604148 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.604296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.604437 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.604578 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.604750 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.604887 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.605072 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.605220 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.605405 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.605542 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.605715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.605859 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.606002 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.606136 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.606314 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.606452 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.606623 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.606760 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.606931 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.607075 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.607241 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.607379 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.607575 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.607724 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.607871 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.608011 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.608174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.608312 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.608489 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.608625 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.608795 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.608938 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.609103 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.609245 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.609409 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.609564 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.609714 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.609908 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.610045 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.610184 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.610325 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.610469 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.610604 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.610744 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.610901 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.611045 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.611224 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.611371 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.611546 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.611696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.611873 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.612012 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.612205 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.612397 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.612629 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.612848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.613003 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.613137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.613137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.613411 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.613545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.613686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.613819 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.613957 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.614100 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.614233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.614365 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.614496 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.614629 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.614760 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.614905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.615047 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.615181 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.615320 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.615484 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.615643 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.615840 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.615986 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.616154 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.616288 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.616467 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.616604 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.616778 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.616921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.617090 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.617227 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.617397 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.617543 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.617707 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.617844 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.618014 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.618155 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.618304 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.618446 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.618606 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.618750 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.618914 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.619059 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.619222 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.619372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.619594 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.619748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.619884 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.620022 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.620163 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.620374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.620510 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.620642 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.620781 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.620924 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.621072 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.621213 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.621355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.621494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.621702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.621907 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.622058 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.622239 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.622381 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.622553 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.622689 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.622872 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.623019 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.623192 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.623338 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.623511 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.623672 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.623855 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.624000 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.624166 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.624303 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.624470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.624608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.624777 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.624928 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.625070 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.625205 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.625408 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.625546 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.625718 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.625855 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.626023 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.626161 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.626385 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.626535 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.626677 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.626809 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.626942 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.627088 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.627225 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.627357 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.627546 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.627699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.627907 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.628107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.628313 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.628548 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.628735 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.628882 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.629025 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.629174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.629310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.629444 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.629588 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.629723 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.629865 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.630010 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.630144 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.630285 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.630421 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.630564 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.630707 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.630867 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.631013 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.631174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.631311 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.631479 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.631658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.631849 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.631994 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.632157 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.632301 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.632495 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.632721 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.632863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.633053 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.633199 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.633368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.633520 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.633688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.633825 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.634008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.634153 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.634326 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.634475 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.634647 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.634797 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.634953 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.635099 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.635264 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.635411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.635597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.635758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.635909 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.636051 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.636185 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.636318 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.636480 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.636618 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.636791 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.636937 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.637215 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.637362 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.637496 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.637637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.637783 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.637917 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.638042 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.638189 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.638366 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.638514 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.638663 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.638802 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.638943 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.639086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.639220 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.639363 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.639496 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.639654 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.639804 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.639939 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.640080 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.640223 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.640357 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.640490 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.640662 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.640801 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.640963 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.641110 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.641287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.641415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.641586 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.641725 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.641886 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.642102 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.642238 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.642376 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.642511 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.642644 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.642790 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.642925 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.643070 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.643205 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.644223 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.644430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.644645 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.644864 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.645071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.645219 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.645362 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.645497 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.645645 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.645789 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.645932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.646073 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.646209 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.646350 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.646494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.646637 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.646780 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.646923 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.647064 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.647209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.647426 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.647580 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.647729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.647872 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.648005 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.648153 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.648297 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.648431 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.648563 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.648704 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.648845 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.648992 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.649134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.649277 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.649411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.649544 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.649684 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.649832 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.649973 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.650107 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.650240 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.650382 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.650530 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.650665 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.650798 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.650930 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.651070 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.651205 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.651350 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.651491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.651693 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.651835 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.651974 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.652107 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.652252 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.652387 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.652518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.652695 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.652839 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.653009 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.653153 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.653326 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.653461 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.653636 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.653779 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.653946 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.654082 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.654258 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.654392 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.654571 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.654714 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.654883 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.655025 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.655193 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.655326 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.655494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.655667 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.655812 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.655947 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.656116 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.656262 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.656438 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.656575 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.656750 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.656901 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.657035 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.657175 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.657345 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.657559 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.657713 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.657854 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.657995 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.658137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.658277 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.658424 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.658566 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.658709 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.658850 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.658993 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.659232 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.659464 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.659770 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.659954 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.660099 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.660235 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.660369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.660513 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.660647 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.660793 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.660935 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.661076 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.661218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.661362 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.661497 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.661648 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.661781 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.661916 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.662059 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.662194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.662336 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.662478 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.662611 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.662752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.662906 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.663049 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.663184 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.663317 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.663494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.663657 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.663810 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.663954 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.664124 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.664270 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.664437 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.664582 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.664748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.664888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.665065 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.665201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.665376 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.665527 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.665692 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.665829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.666000 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.666145 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.666303 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.666455 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.666628 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.666779 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.666921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.667056 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.667235 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.667383 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.667629 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.667787 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.667932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.668073 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.668208 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.668352 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.668486 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.668619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.668789 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.668935 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.669102 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.669241 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.669411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.669557 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.669728 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.669867 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.670038 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.670184 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.670349 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.670495 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.670637 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.670776 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.670995 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.671131 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.671267 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.671400 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.671560 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.671697 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.671872 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.672018 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.672181 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.672318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.672492 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.672640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.672781 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.672923 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.673111 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.673312 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.673454 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.673598 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.673733 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.673896 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.674035 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.674220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.674372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.674549 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.675293 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.675502 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.675740 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.675965 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.676153 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.676299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.676434 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.676569 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.676705 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.676839 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.676987 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.677128 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.677263 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.677448 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.677584 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.677741 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.677973 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.678144 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.678271 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.678411 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.678543 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.678685 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.678829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.678961 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.679102 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.679244 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.679436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.679653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.679812 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.679955 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.680097 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.680232 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.680372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.680516 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.680650 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.680784 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.680971 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.681120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.681264 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.681406 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.681572 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.681711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.681878 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.682017 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.682188 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.682323 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.682495 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.682622 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.682810 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.682952 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.683124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.683270 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.683435 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.683606 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.683750 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.683919 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.684065 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.684336 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.684475 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.684944 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.685095 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.685240 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.685383 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.685524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.685659 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.685659 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.685920 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.686063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.686205 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.686205 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.686446 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.686585 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.686728 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.686862 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.686994 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.687135 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.687275 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.687409 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.687613 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.687751 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.687896 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.688121 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.688260 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.688404 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.688553 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.688694 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.688835 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.688969 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.689103 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.689251 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.689393 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.689534 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.689668 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.689809 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.689942 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.690136 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.690284 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.691046 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.691271 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.691481 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.691730 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.691904 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.692051 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.692195 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.692332 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.692508 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.692655 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.692801 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.692945 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.693114 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.693260 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.693418 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.693639 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.693777 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.693918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.694060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.694254 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.694391 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.694538 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.694683 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.694817 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.694951 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.695088 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.695222 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.695370 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.695506 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.695702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.695845 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.695979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.696120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.696263 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.696398 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.696529 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.696706 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.696843 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.697011 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.697149 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.697313 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.697450 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.697654 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.697794 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.697942 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.698101 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.698312 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.698449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.698591 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.698722 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.698865 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.699006 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.699170 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.699308 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.699501 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.699658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.699811 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.699954 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.700145 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.700283 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.700458 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.700608 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.700774 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.700912 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.701088 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.701233 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.701402 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.701553 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.701716 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.701854 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.702030 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] pci.passthrough_whitelist = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.702173 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.702341 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.702486 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.702657 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.702804 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.702946 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.703086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.703251 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.703398 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.703583 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.703822 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.703960 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.704149 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.704299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.704458 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.704593 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.704767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.704913 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.705071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.705221 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.705364 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.705498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.705663 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.705801 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.706011 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.706215 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.706422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.706626 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.706831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.706970 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.707095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.707229 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.707365 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.707509 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.707693 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.707837 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.707982 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.708124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.708259 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.708477 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.708623 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.708765 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.708899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.disk_driver = localdisk {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.709041 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.709183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.proc_units_factor = 0.1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.709325 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.709460 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] powervm.volume_group_name = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.709594 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.709725 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.709893 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.710052 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.710190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.710331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.710498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.710637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.710810 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.710958 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.711125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.711271 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.711439 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.711631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.711780 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.711925 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.712068 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.712204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.712369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.712508 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.712681 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.712826 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.712992 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.713140 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.713303 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.713441 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.713617 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.713754 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.713929 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.714149 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.714289 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.714477 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.714616 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.714792 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.714930 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.715107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.715253 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.715419 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.715601 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.715761 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.715922 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.716072 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.716322 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.716462 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.716637 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.716782 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.716961 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.717106 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.717272 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.717405 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.717595 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.717730 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.717914 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.718052 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.718232 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.718369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.718575 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.718726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.718875 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.719097 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.719238 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.719379 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.719557 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.719712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.719857 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.719980 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.720119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.720261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.720406 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.720554 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.720689 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.720831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.720972 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.721107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.721262 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.721397 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.722071 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.722232 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.722568 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.722800 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.723036 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.723175 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.723318 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.723460 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.723629 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.723769 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.723916 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.724059 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.724201 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.724344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.724479 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.724623 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.724759 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.724893 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.725025 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.725167 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.725351 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.725500 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.725672 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.725820 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.725986 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.726124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.726302 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.726454 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.726611 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.726739 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.726924 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.727131 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.727256 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.727448 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.727606 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.727809 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.727948 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.728137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.728287 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.728459 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.728595 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.728819 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.728965 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.729095 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.729239 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.729374 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.729508 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.729648 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.729789 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.729931 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.730064 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.730206 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.730348 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.730516 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.730654 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.730820 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.730968 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.731133 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.731271 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.731438 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.731613 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.731764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.731900 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.732062 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.732211 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.732375 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.732522 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.732681 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.732913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.733057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.733264 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.733402 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.733585 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.733733 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.733916 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.734054 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.734245 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.734383 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.734560 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.734705 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.734867 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.735003 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.735194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.735338 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.735482 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.735653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.735820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.735958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.736138 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.736279 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.736453 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.736592 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.736760 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.736988 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.737126 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.737980 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.738219 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.738459 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.738626 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.738785 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.738997 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.739144 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.739282 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.739428 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.739618 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.739754 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.739908 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.740053 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.740180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.740320 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.740463 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.740604 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.740738 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.740881 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.741016 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.741158 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.741292 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.741425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.741560 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.741702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.741869 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.742007 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.742179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.742323 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.742487 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.742636 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.742798 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.742933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.743102 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.743237 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.743411 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.743581 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.743730 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.744047 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.744357 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.744500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.744676 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.744824 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.745021 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.745159 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.745346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.745483 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.745664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.745803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.745975 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.746119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.746291 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.746437 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.746604 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.746743 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.746916 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.747062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.747228 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.747376 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.747583 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.747736 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.747880 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.748002 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.748185 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.748329 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.748501 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.748809 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.748962 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.749170 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.749298 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.749445 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.749587 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.749778 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.749924 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.750117 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.750269 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.750432 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.750570 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.750742 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.750879 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.751052 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.751204 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.751370 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.751506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.751710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.751846 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.752025 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.752170 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.752338 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.752474 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.752650 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.752821 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.753112 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.753335 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.753558 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.753699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.753840 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.753974 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.754120 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.754262 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.754395 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.754533 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.754673 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.754806 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.754947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.755079 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.755211 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.755343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.755482 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.755665 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.755800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.755963 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.756091 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.756274 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.756404 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.756580 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.756714 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.756886 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.757032 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.757195 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.757349 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.757501 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.757664 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.757810 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.757977 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.758115 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.758288 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.758435 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.758601 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.758744 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.758917 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.759052 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.759282 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.759423 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.759612 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.759760 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.759903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.760046 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.760191 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.760324 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.760484 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.760629 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.760787 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.760931 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.761080 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.761215 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.761378 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.761526 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.761710 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.761857 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.762043 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.762181 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.762359 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.762496 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.762683 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.762831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.762996 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.763135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.763318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.763454 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.763652 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.763810 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.763975 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.764113 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.764297 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.764434 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.764603 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.764748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.764911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.765055 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.765215 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.765351 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.765526 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.765658 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.765842 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.765964 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.766150 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.766278 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.766456 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.766595 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.766761 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.766899 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.767115 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.767268 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.767418 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.767580 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.767718 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.767864 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.767999 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.768146 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.768528 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.768684 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.768900 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.769133 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.769295 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.769526 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.769665 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.769799 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.769937 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.770071 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.770212 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.770355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.770490 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.770631 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.770773 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.770909 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.771041 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.771183 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.771318 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.771459 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.771610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.771747 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.771894 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.772031 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.772164 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.772296 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.772428 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.772569 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.772716 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.772885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.773025 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.773195 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.773332 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.773526 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.773673 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.773854 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.773991 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.774203 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.774347 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.774517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.774663 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.774835 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.774971 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.775160 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.775299 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.775477 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.775680 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.775826 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.775963 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.776104 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.776244 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.776393 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118133) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 13:07:36.776528 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.776720 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.777027 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.777338 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.777649 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.777959 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = True {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.778350 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.778610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.778915 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.779239 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.779589 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.779912 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.780235 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.780545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.780875 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.781185 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.781494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.781808 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.782117 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.782430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.782744 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.783059 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.783387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.783738 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.784562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.784912 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.785231 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.785578 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.785891 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.786236 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.786569 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.786887 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.787199 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.787511 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Jun 06 13:07:36.787763 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=118134) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Jun 06 13:07:36.836688 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO dbcounter [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] Registered counter for database nova_api Jun 06 13:07:36.849331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO dbcounter [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] Registered counter for database nova_api Jun 06 13:07:36.857141 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_db.sqlalchemy.engines [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 13:07:36.864350 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writer thread running {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 13:07:36.870263 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_db.sqlalchemy.engines [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 13:07:36.877167 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writer thread running {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 13:07:36.921492 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.context [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96733054-82d0-4cbf-8560-31148af40a94(cell1) {{(pid=118133) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 13:07:36.926510 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:07:36.928367 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:07:36.929203 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:07:36.931186 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:07:36.933225 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO dbcounter [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] Registered counter for database nova_cell0 Jun 06 13:07:36.935763 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.context [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),96733054-82d0-4cbf-8560-31148af40a94(cell1) {{(pid=118134) load_cells /opt/stack/nova/nova/context.py:464}} Jun 06 13:07:36.938770 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO dbcounter [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] Registered counter for database nova_cell1 Jun 06 13:07:36.940053 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:07:36.942129 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:07:36.942808 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:07:36.944827 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:07:36.946006 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_db.sqlalchemy.engines [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 13:07:36.946907 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO dbcounter [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] Registered counter for database nova_cell0 Jun 06 13:07:36.948247 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_db.sqlalchemy.engines [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 13:07:36.952498 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO dbcounter [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] Registered counter for database nova_cell1 Jun 06 13:07:36.954026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writer thread running {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 13:07:36.955400 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writer thread running {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 13:07:36.961770 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_db.sqlalchemy.engines [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 13:07:36.963619 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_db.sqlalchemy.engines [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 13:07:36.970700 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writer thread running {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 13:07:36.972873 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writer thread running {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 13:07:37.109565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO dbcounter [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] Registered counter for database nova_cell0 Jun 06 13:07:37.117205 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_db.sqlalchemy.engines [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118133) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 13:07:37.122607 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writer thread running {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 13:07:37.124415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO dbcounter [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] Registered counter for database nova_cell0 Jun 06 13:07:37.133046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_db.sqlalchemy.engines [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=118134) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Jun 06 13:07:37.137818 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writer thread running {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Jun 06 13:07:37.564233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: WARNING keystonemiddleware.auth_token [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 13:07:37.571788 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: WARNING keystonemiddleware.auth_token [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 13:07:37.575696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: WARNING keystonemiddleware.auth_token [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 13:07:37.583065 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: WARNING keystonemiddleware.auth_token [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 13:07:37.794820 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: WARNING keystonemiddleware.auth_token [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 13:07:37.801706 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: WARNING keystonemiddleware.auth_token [None req-63b52a72-63eb-4e19-a38a-4a5e8fa528f2 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 13:07:37.805584 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: WARNING keystonemiddleware.auth_token [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Jun 06 13:07:37.807002 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55abc3e379c0 pid: 118133 (default app) Jun 06 13:07:37.811502 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: WARNING keystonemiddleware.auth_token [None req-e01c1548-9107-4cc6-a878-db1929baa378 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Jun 06 13:07:37.816699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: WSGI app 0 (mountpoint='') ready in 5 seconds on interpreter 0x55abc3e379c0 pid: 118134 (default app) Jun 06 13:08:20.264086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:20.265017 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:20.265887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:20.267069 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:21.066860 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-29df3f35-42d4-4a05-82fd-f2c03c33db5b tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Action: 'create', calling method: .version_select at 0x7f0efd061790>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-46094565"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:21.621593 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=3 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:21.622404 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=3 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:21.623652 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=3 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:21.625727 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=3 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:21.836317 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-051c31ca-e238-4adb-ae94-61eb94d4db0e tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] Calling method '.version_select at 0x7f0efd2dd790>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:22.296054 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-051c31ca-e238-4adb-ae94-61eb94d4db0e tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/9a9d69fe-fdb1-4909-b011-99e8ef6c5833" status: 200 len: 351 microversion: 2.1 time: 0.679359 Jun 06 13:08:22.296905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 1/1] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:08:21 2022] GET /compute/v2.1/os-volumes/9a9d69fe-fdb1-4909-b011-99e8ef6c5833 => generated 351 bytes in 682 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:22.373197 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-29df3f35-42d4-4a05-82fd-f2c03c33db5b tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 343 microversion: 2.1 time: 2.113895 Jun 06 13:08:22.381554 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 1/2] 10.222.0.13 () {60 vars in 1154 bytes} [Mon Jun 6 13:08:20 2022] POST /compute/v2.1/os-volumes => generated 343 bytes in 2117 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 06 13:08:22.389506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e0f0f145-9815-4cb4-a267-39cbd8fd90f4 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efcf758b0>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:22.559224 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e0f0f145-9815-4cb4-a267-39cbd8fd90f4 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a" status: 200 len: 343 microversion: 2.1 time: 0.176036 Jun 06 13:08:22.559814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 2/3] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:08:22 2022] GET /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a => generated 343 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:23.538592 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1331738440", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "networks": [{"uuid": "55e65e14-c2ab-4df6-bd1a-6444712da247"}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:23.575249 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-45156d8f-3e57-45d8-9b25-24006632e8ce tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efcf75430>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:23.639269 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] validate_networks() for [('55e65e14-c2ab-4df6-bd1a-6444712da247', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:08:23.683092 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-45156d8f-3e57-45d8-9b25-24006632e8ce tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a" status: 200 len: 344 microversion: 2.1 time: 0.114135 Jun 06 13:08:23.683686 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 3/4] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:08:23 2022] GET /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a => generated 344 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:23.696344 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2a9d45c5-7fdb-47b6-99e3-59bb4c574ba4 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Action: 'create', calling method: .version_select at 0x7f0efcf75ee0>, body: {"snapshot": {"volume_id": "d7730058-899b-4568-97b4-753093ceaf9a", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-759811819"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:24.523226 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2a9d45c5-7fdb-47b6-99e3-59bb4c574ba4 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.831498 Jun 06 13:08:24.524058 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 4/5] 10.222.0.13 () {60 vars in 1161 bytes} [Mon Jun 6 13:08:23 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 833 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:24.529138 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-13f7e1c3-0329-4e81-849e-e354377c51f0 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] Calling method '.version_select at 0x7f0efcf36160>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:24.603766 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-13f7e1c3-0329-4e81-849e-e354377c51f0 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/628e0e60-c890-45a3-a2b1-6f76f871b46d" status: 200 len: 350 microversion: 2.1 time: 0.078463 Jun 06 13:08:24.606021 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 5/6] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:08:24 2022] GET /compute/v2.1/os-volumes/628e0e60-c890-45a3-a2b1-6f76f871b46d => generated 350 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:24.611562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0c790aa9-8860-4d80-a2b7-a49324cfc5a3 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efcf753a0>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:24.761992 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0c790aa9-8860-4d80-a2b7-a49324cfc5a3 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd" status: 200 len: 286 microversion: 2.1 time: 0.152386 Jun 06 13:08:24.762599 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 6/7] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 13:08:24 2022] GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd => generated 286 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:24.775960 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-998be7c8-4873-4417-97f2-5f916f2638ff tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efd90f5e0>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:24.859360 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-998be7c8-4873-4417-97f2-5f916f2638ff tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.088776 Jun 06 13:08:24.859995 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 7/8] 10.222.0.13 () {58 vars in 1139 bytes} [Mon Jun 6 13:08:24 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:24.870498 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b6b17857-9540-43de-94d1-ca45c53f3591 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efcf36a60>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:24.935341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b6b17857-9540-43de-94d1-ca45c53f3591 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd" status: 200 len: 286 microversion: 2.1 time: 0.068790 Jun 06 13:08:24.936971 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 8/9] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 13:08:24 2022] GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd => generated 286 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:25.363857 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:08:25.369410 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:08:25.369908 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:08:25.370318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:08:25.370866 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:08:25.392132 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:25.402423 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:25.403335 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:25.403837 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:25.444012 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Getting quotas for project 9e72dd6caaa243f9ac9989f766976e30. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:08:25.455188 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Getting quotas for user 6c12284a3fb845a5b6c073fcb98913ee and project 9e72dd6caaa243f9ac9989f766976e30. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:08:25.471135 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:08:25.474677 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:08:25.679835 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b306a4f0-f9aa-4dd3-9ef3-586cafd6c38e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 2.266250 Jun 06 13:08:25.681770 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 2/10] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:08:23 2022] POST /compute/v2.1/servers => generated 380 bytes in 2271 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:08:25.693821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-256ffdcf-2307-4128-a0a6-1f78087607d7 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:25.694566 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-256ffdcf-2307-4128-a0a6-1f78087607d7 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:25.957716 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7d5b0784-6119-49a7-a9d6-b8563812db86 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efce4a430>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:26.031398 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7d5b0784-6119-49a7-a9d6-b8563812db86 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd" status: 200 len: 286 microversion: 2.1 time: 0.087239 Jun 06 13:08:26.032507 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 3/11] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 13:08:25 2022] GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd => generated 286 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:26.167201 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-256ffdcf-2307-4128-a0a6-1f78087607d7 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:26.191282 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-256ffdcf-2307-4128-a0a6-1f78087607d7 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1215 microversion: 2.1 time: 0.501106 Jun 06 13:08:26.205258 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 9/12] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:25 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1215 bytes in 516 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:27.044520 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-be367e33-f001-4a83-9f9c-523d879f8d3c tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efce4a700>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:27.121130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-be367e33-f001-4a83-9f9c-523d879f8d3c tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd" status: 200 len: 286 microversion: 2.1 time: 0.082227 Jun 06 13:08:27.121987 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 4/13] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 13:08:27 2022] GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd => generated 286 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:27.221648 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cd1c4717-5ad1-4da5-b17e-02e5d2e52639 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:27.222262 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-cd1c4717-5ad1-4da5-b17e-02e5d2e52639 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:27.754797 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cd1c4717-5ad1-4da5-b17e-02e5d2e52639 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:27.767121 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cd1c4717-5ad1-4da5-b17e-02e5d2e52639 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1215 microversion: 2.1 time: 0.558347 Jun 06 13:08:27.769592 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 10/14] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:27 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1215 bytes in 562 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:28.135788 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c4baec20-25bb-4d2e-a683-2caeeaaf2af3 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efce4a940>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:28.200816 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c4baec20-25bb-4d2e-a683-2caeeaaf2af3 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd" status: 200 len: 287 microversion: 2.1 time: 0.071599 Jun 06 13:08:28.202783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 5/15] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 13:08:28 2022] GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd => generated 287 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:28.214091 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-684e159f-c96f-434d-90bd-3777c5d39f80 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efcf018b0>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:28.516303 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-684e159f-c96f-434d-90bd-3777c5d39f80 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "DELETE /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd" status: 202 len: 0 microversion: 2.1 time: 0.306382 Jun 06 13:08:28.518201 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 11/16] 10.222.0.13 () {58 vars in 1253 bytes} [Mon Jun 6 13:08:28 2022] DELETE /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd => generated 0 bytes in 309 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:08:28.526822 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-80c070e4-5a0d-4575-98b3-55f0730ecad5 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efce4af70>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:28.596647 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-80c070e4-5a0d-4575-98b3-55f0730ecad5 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd" status: 200 len: 286 microversion: 2.1 time: 0.074113 Jun 06 13:08:28.597446 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 6/17] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 13:08:28 2022] GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd => generated 286 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:28.786527 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-479d3b0a-4e46-4daa-826a-0d68a67c96bd tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:28.787300 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-479d3b0a-4e46-4daa-826a-0d68a67c96bd tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:28.803586 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-479d3b0a-4e46-4daa-826a-0d68a67c96bd tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:28.805603 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-479d3b0a-4e46-4daa-826a-0d68a67c96bd tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:28.806464 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-479d3b0a-4e46-4daa-826a-0d68a67c96bd tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:28.818296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-479d3b0a-4e46-4daa-826a-0d68a67c96bd tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:28.913727 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f44aa842-e7ac-49fd-a6e0-c2f03e6682e1 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] Calling method '.version_select at 0x7f0efce4ae50>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:29.036778 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f44aa842-e7ac-49fd-a6e0-c2f03e6682e1 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/c5a1720a-750d-4337-872f-b8fb41e300a7" status: 200 len: 350 microversion: 2.1 time: 0.128312 Jun 06 13:08:29.037379 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 7/18] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:08:28 2022] GET /compute/v2.1/os-volumes/c5a1720a-750d-4337-872f-b8fb41e300a7 => generated 350 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:29.049467 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fae47e65-58a8-4f2e-bfe5-ad17ff353426 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] Calling method '.version_select at 0x7f0efce4a160>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:29.219942 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-479d3b0a-4e46-4daa-826a-0d68a67c96bd tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:29.253630 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-479d3b0a-4e46-4daa-826a-0d68a67c96bd tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1219 microversion: 2.1 time: 0.474014 Jun 06 13:08:29.264564 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 12/19] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:28 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1219 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:29.288977 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fae47e65-58a8-4f2e-bfe5-ad17ff353426 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.243894 Jun 06 13:08:29.298092 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 8/20] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Jun 6 13:08:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:08:29.305811 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cdba981f-949a-4586-b608-1c8a2344c9f6 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] Calling method '.version_select at 0x7f0efce7caf0>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:29.454923 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cdba981f-949a-4586-b608-1c8a2344c9f6 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.154502 Jun 06 13:08:29.455487 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 13/21] 10.222.0.13 () {58 vars in 1148 bytes} [Mon Jun 6 13:08:29 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 693 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:29.470226 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3a2b240d-a6d5-4ad2-adf0-119080a7eb80 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] Calling method '.version_select at 0x7f0efce54280>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:29.609422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e66bfd46-666c-46aa-aa6e-8828023322e0 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efce7cd30>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:29.681675 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-e66bfd46-666c-46aa-aa6e-8828023322e0 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] HTTP exception thrown: Snapshot ae923e04-f372-4856-95ff-32707d1285bd could not be found. Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e66bfd46-666c-46aa-aa6e-8828023322e0 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Request method failure captured: Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd HTTP/1.1 Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxEyhVnFMaf6tUBvqwqF53vrXzvLxjT4Z58Do7sA9GwiL1Ab3xUtPHMVHsWO0GTpoussWSyiYqTAvlznXYorirwlNuhH08o7lzzM2dDVErHltEJM5_7ge0jiS2sTgV0FUAwwLkbesLdA_U_4KeCYZr_0SjB_i0Bkqx4rIx-Zx9CcH8 Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: b6c8686c006d4c31966ec3d477dbfd20 Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-536085491 Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:08:29.686291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:08:29.687637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6c8686c006d4c31966ec3d477dbfd20", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c8686c006d4c31966ec3d477dbfd20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c8686c006d4c31966ec3d477dbfd20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6c8686c006d4c31966ec3d477dbfd20"}]}] Jun 06 13:08:29.687637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-VolumesSnapshotsTestJSON-536085491 Jun 06 13:08:29.687637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: b6c8686c006d4c31966ec3d477dbfd20 Jun 06 13:08:29.687637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-536085491 Jun 06 13:08:29.687637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-VolumesSnapshotsTestJSON-536085491-project Jun 06 13:08:29.687637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:08:29.687637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:08:29.687637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 8fc62a97460647269febeaa1df22e4bc Jun 06 13:08:29.687637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-VolumesSnapshotsTestJSON-536085491-project Jun 06 13:08:29.687637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: Jun 06 13:08:29.687637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Snapshot ae923e04-f372-4856-95ff-32707d1285bd could not be found. Jun 06 13:08:29.687637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': 'ae923e04-f372-4856-95ff-32707d1285bd'} Jun 06 13:08:29.687637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot ae923e04-f372-4856-95ff-32707d1285bd could not be found. (HTTP 404) (Request-ID: req-82ac3da3-50b1-4af4-aac8-5e480fe8427f) Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:29.688296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 13:08:29.689173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot ae923e04-f372-4856-95ff-32707d1285bd could not be found. Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Jun 06 13:08:29.690106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:08:29.691095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot ae923e04-f372-4856-95ff-32707d1285bd could not be found. Jun 06 13:08:29.691095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:29.691095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:08:29.691095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:29.691095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:29.691095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:08:29.691095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:08:29.691095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:08:29.691095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:08:29.691095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot ae923e04-f372-4856-95ff-32707d1285bd could not be found. Jun 06 13:08:29.691095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:29.693856 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e66bfd46-666c-46aa-aa6e-8828023322e0 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Returning 404 to user: Snapshot ae923e04-f372-4856-95ff-32707d1285bd could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:08:29.694895 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e66bfd46-666c-46aa-aa6e-8828023322e0 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd" status: 404 len: 111 microversion: 2.1 time: 0.090118 Jun 06 13:08:29.694996 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3a2b240d-a6d5-4ad2-adf0-119080a7eb80 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] 10.222.0.13 "GET /compute/v2.1/os-volumes" status: 200 len: 1034 microversion: 2.1 time: 0.229704 Jun 06 13:08:29.695869 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 9/22] 10.222.0.13 () {58 vars in 1133 bytes} [Mon Jun 6 13:08:29 2022] GET /compute/v2.1/os-volumes => generated 1034 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:29.696678 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 14/23] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 13:08:29 2022] GET /compute/v2.1/os-snapshots/ae923e04-f372-4856-95ff-32707d1285bd => generated 111 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:08:29.704537 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9d16d73b-d51a-4a62-ba36-16cfe0e81563 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efce4a430>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:29.723186 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1f901f7b-0b46-470a-b8d1-4bf1d7b63073 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] Calling method '.version_select at 0x7f0efd191430>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:30.021863 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1f901f7b-0b46-470a-b8d1-4bf1d7b63073 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] 10.222.0.13 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.310482 Jun 06 13:08:30.022793 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 15/24] 10.222.0.13 () {58 vars in 1166 bytes} [Mon Jun 6 13:08:29 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 353 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:30.035828 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3632b6d1-a5b0-49db-bfa8-b55d031d6809 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] Calling method '.version_select at 0x7f0efce18310>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:30.098079 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9d16d73b-d51a-4a62-ba36-16cfe0e81563 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a" status: 202 len: 0 microversion: 2.1 time: 0.398060 Jun 06 13:08:30.099226 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 10/25] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 13:08:29 2022] DELETE /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a => generated 0 bytes in 400 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 13:08:30.106882 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6f11a7bc-0078-43b7-9bc8-16df4d7631df tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efce4a0d0>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:30.231434 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6f11a7bc-0078-43b7-9bc8-16df4d7631df tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a" status: 200 len: 343 microversion: 2.1 time: 0.128306 Jun 06 13:08:30.232306 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 11/26] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:08:30 2022] GET /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a => generated 343 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:08:30.271125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e4c82990-904e-4a9f-82e5-34c35108ace5 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:30.271784 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e4c82990-904e-4a9f-82e5-34c35108ace5 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:30.303418 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3632b6d1-a5b0-49db-bfa8-b55d031d6809 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 693 microversion: 2.1 time: 0.272359 Jun 06 13:08:30.304513 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 16/27] 10.222.0.13 () {58 vars in 1169 bytes} [Mon Jun 6 13:08:30 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 693 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:30.308694 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e4c82990-904e-4a9f-82e5-34c35108ace5 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:30.309257 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e4c82990-904e-4a9f-82e5-34c35108ace5 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:30.310098 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e4c82990-904e-4a9f-82e5-34c35108ace5 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:30.318035 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c4387385-1d22-469b-8c19-5616f10dd659 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] Calling method '.version_select at 0x7f0efce37e50>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:30.322986 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e4c82990-904e-4a9f-82e5-34c35108ace5 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:30.617019 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c4387385-1d22-469b-8c19-5616f10dd659 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.287112 Jun 06 13:08:30.617019 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 17/28] 10.222.0.13 () {58 vars in 1154 bytes} [Mon Jun 6 13:08:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:30.618345 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9dfb9b42-d76b-465a-93c5-e9e88461a316 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] Calling method '.version_select at 0x7f0efcd9daf0>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:30.856755 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9dfb9b42-d76b-465a-93c5-e9e88461a316 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 353 microversion: 2.1 time: 0.242813 Jun 06 13:08:30.863876 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 18/29] 10.222.0.13 () {58 vars in 1187 bytes} [Mon Jun 6 13:08:30 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 353 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:30.863970 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e4c82990-904e-4a9f-82e5-34c35108ace5 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:30.872015 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2c37c035-ed97-4c1b-bafb-16d99a0502c1 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] Calling method '.version_select at 0x7f0efcd9d280>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:30.915853 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e4c82990-904e-4a9f-82e5-34c35108ace5 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1275 microversion: 2.1 time: 0.636217 Jun 06 13:08:30.919823 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 12/30] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:30 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1275 bytes in 654 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:08:31.053249 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2c37c035-ed97-4c1b-bafb-16d99a0502c1 tempest-VolumesTestJSON-785778261 tempest-VolumesTestJSON-785778261-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1034 microversion: 2.1 time: 0.187075 Jun 06 13:08:31.053814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 19/31] 10.222.0.13 () {58 vars in 1154 bytes} [Mon Jun 6 13:08:30 2022] GET /compute/v2.1/os-volumes/detail => generated 1034 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:31.245154 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-596fa6c3-127f-4b29-b2b0-f6db72991ebc tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efc519c10>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:31.316081 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-596fa6c3-127f-4b29-b2b0-f6db72991ebc tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] HTTP exception thrown: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-596fa6c3-127f-4b29-b2b0-f6db72991ebc tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Request method failure captured: Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a HTTP/1.1 Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxEyhVnFMaf6tUBvqwqF53vrXzvLxjT4Z58Do7sA9GwiL1Ab3xUtPHMVHsWO0GTpoussWSyiYqTAvlznXYorirwlNuhH08o7lzzM2dDVErHltEJM5_7ge0jiS2sTgV0FUAwwLkbesLdA_U_4KeCYZr_0SjB_i0Bkqx4rIx-Zx9CcH8 Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: b6c8686c006d4c31966ec3d477dbfd20 Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-536085491 Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:08:31.322259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:08:31.324147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6c8686c006d4c31966ec3d477dbfd20", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c8686c006d4c31966ec3d477dbfd20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c8686c006d4c31966ec3d477dbfd20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6c8686c006d4c31966ec3d477dbfd20"}]}] Jun 06 13:08:31.324147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-VolumesSnapshotsTestJSON-536085491 Jun 06 13:08:31.324147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: b6c8686c006d4c31966ec3d477dbfd20 Jun 06 13:08:31.324147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-536085491 Jun 06 13:08:31.324147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-VolumesSnapshotsTestJSON-536085491-project Jun 06 13:08:31.324147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:08:31.324147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:08:31.324147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 8fc62a97460647269febeaa1df22e4bc Jun 06 13:08:31.324147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-VolumesSnapshotsTestJSON-536085491-project Jun 06 13:08:31.324147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: Jun 06 13:08:31.324147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.324147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': 'd7730058-899b-4568-97b4-753093ceaf9a'} Jun 06 13:08:31.324147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. (HTTP 404) (Request-ID: req-4b96ff38-8f0c-4b0b-a0b0-68c5b0da5cc8) Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:08:31.324927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 13:08:31.326060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 13:08:31.327815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:08:31.328887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.328887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.328887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:08:31.328887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.328887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:31.328887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:08:31.328887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:08:31.328887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:08:31.328887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:08:31.328887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.328887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.331877 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-596fa6c3-127f-4b29-b2b0-f6db72991ebc tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Returning 404 to user: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:08:31.331877 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-596fa6c3-127f-4b29-b2b0-f6db72991ebc tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a" status: 404 len: 109 microversion: 2.1 time: 0.089996 Jun 06 13:08:31.331877 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 13/32] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:08:31 2022] GET /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a => generated 109 bytes in 91 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:08:31.345422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-edbbdb2e-b9d1-4dd2-b63f-409542453318 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efce28af0>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:31.412978 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-edbbdb2e-b9d1-4dd2-b63f-409542453318 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] HTTP exception thrown: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-edbbdb2e-b9d1-4dd2-b63f-409542453318 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Request method failure captured: Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: DELETE /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a HTTP/1.1 Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxEyhVnFMaf6tUBvqwqF53vrXzvLxjT4Z58Do7sA9GwiL1Ab3xUtPHMVHsWO0GTpoussWSyiYqTAvlznXYorirwlNuhH08o7lzzM2dDVErHltEJM5_7ge0jiS2sTgV0FUAwwLkbesLdA_U_4KeCYZr_0SjB_i0Bkqx4rIx-Zx9CcH8 Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: b6c8686c006d4c31966ec3d477dbfd20 Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-536085491 Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:08:31.415849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:08:31.416940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6c8686c006d4c31966ec3d477dbfd20", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c8686c006d4c31966ec3d477dbfd20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c8686c006d4c31966ec3d477dbfd20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6c8686c006d4c31966ec3d477dbfd20"}]}] Jun 06 13:08:31.416940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-VolumesSnapshotsTestJSON-536085491 Jun 06 13:08:31.416940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: b6c8686c006d4c31966ec3d477dbfd20 Jun 06 13:08:31.416940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-536085491 Jun 06 13:08:31.416940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-VolumesSnapshotsTestJSON-536085491-project Jun 06 13:08:31.416940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:08:31.416940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:08:31.416940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 8fc62a97460647269febeaa1df22e4bc Jun 06 13:08:31.416940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-VolumesSnapshotsTestJSON-536085491-project Jun 06 13:08:31.416940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: Jun 06 13:08:31.416940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.416940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': 'd7730058-899b-4568-97b4-753093ceaf9a'} Jun 06 13:08:31.416940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. (HTTP 404) (Request-ID: req-85e9c218-acda-4a20-9b15-e9778474b389) Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:08:31.417751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 13:08:31.418821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 13:08:31.426899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-edbbdb2e-b9d1-4dd2-b63f-409542453318 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Returning 404 to user: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-edbbdb2e-b9d1-4dd2-b63f-409542453318 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a" status: 404 len: 109 microversion: 2.1 time: 0.081052 Jun 06 13:08:31.428204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 20/33] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 13:08:31 2022] DELETE /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a => generated 109 bytes in 82 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 13:08:31.434472 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-12487592-1db9-4044-8ccc-e3ccc821aea4 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Calling method '.version_select at 0x7f0efc506790>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:31.508280 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-12487592-1db9-4044-8ccc-e3ccc821aea4 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] HTTP exception thrown: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-12487592-1db9-4044-8ccc-e3ccc821aea4 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Request method failure captured: Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a HTTP/1.1 Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxEyhVnFMaf6tUBvqwqF53vrXzvLxjT4Z58Do7sA9GwiL1Ab3xUtPHMVHsWO0GTpoussWSyiYqTAvlznXYorirwlNuhH08o7lzzM2dDVErHltEJM5_7ge0jiS2sTgV0FUAwwLkbesLdA_U_4KeCYZr_0SjB_i0Bkqx4rIx-Zx9CcH8 Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: b6c8686c006d4c31966ec3d477dbfd20 Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-536085491 Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:08:31.510426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:08:31.511498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_b6c8686c006d4c31966ec3d477dbfd20", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c8686c006d4c31966ec3d477dbfd20"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/b6c8686c006d4c31966ec3d477dbfd20"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/b6c8686c006d4c31966ec3d477dbfd20"}]}] Jun 06 13:08:31.511498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-VolumesSnapshotsTestJSON-536085491 Jun 06 13:08:31.511498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: b6c8686c006d4c31966ec3d477dbfd20 Jun 06 13:08:31.511498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-536085491 Jun 06 13:08:31.511498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-VolumesSnapshotsTestJSON-536085491-project Jun 06 13:08:31.511498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:08:31.511498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:08:31.511498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 8fc62a97460647269febeaa1df22e4bc Jun 06 13:08:31.511498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-VolumesSnapshotsTestJSON-536085491-project Jun 06 13:08:31.511498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: Jun 06 13:08:31.511498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.511498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': 'd7730058-899b-4568-97b4-753093ceaf9a'} Jun 06 13:08:31.511498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. (HTTP 404) (Request-ID: req-3646bfe5-2fc5-43d8-b1e1-a9566c68f49f) Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:08:31.512699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 13:08:31.513602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 13:08:31.515015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-12487592-1db9-4044-8ccc-e3ccc821aea4 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] Returning 404 to user: Volume d7730058-899b-4568-97b4-753093ceaf9a could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-12487592-1db9-4044-8ccc-e3ccc821aea4 tempest-VolumesSnapshotsTestJSON-536085491 tempest-VolumesSnapshotsTestJSON-536085491-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a" status: 404 len: 109 microversion: 2.1 time: 0.083019 Jun 06 13:08:31.516105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 14/34] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:08:31 2022] GET /compute/v2.1/os-volumes/d7730058-899b-4568-97b4-753093ceaf9a => generated 109 bytes in 84 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:08:31.945475 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f50d99b6-5083-4208-baa4-821edab67555 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:31.946246 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f50d99b6-5083-4208-baa4-821edab67555 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:31.958616 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f50d99b6-5083-4208-baa4-821edab67555 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:31.959231 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f50d99b6-5083-4208-baa4-821edab67555 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:31.960149 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f50d99b6-5083-4208-baa4-821edab67555 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:31.960716 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f50d99b6-5083-4208-baa4-821edab67555 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:32.247426 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f50d99b6-5083-4208-baa4-821edab67555 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:32.266684 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f50d99b6-5083-4208-baa4-821edab67555 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1273 microversion: 2.1 time: 0.325379 Jun 06 13:08:32.280898 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 21/35] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:31 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1273 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:33.289972 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3e4c9220-7375-44cf-8b83-0ae800304f16 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:33.292130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3e4c9220-7375-44cf-8b83-0ae800304f16 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:33.307474 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e4c9220-7375-44cf-8b83-0ae800304f16 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:33.315759 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e4c9220-7375-44cf-8b83-0ae800304f16 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:33.317953 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e4c9220-7375-44cf-8b83-0ae800304f16 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:33.318751 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e4c9220-7375-44cf-8b83-0ae800304f16 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:33.533019 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3e4c9220-7375-44cf-8b83-0ae800304f16 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:33.548961 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3e4c9220-7375-44cf-8b83-0ae800304f16 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1273 microversion: 2.1 time: 0.262727 Jun 06 13:08:33.549870 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 15/36] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:33 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1273 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:34.567770 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-79b27cd2-8c44-4fe2-a4cc-522b1ff66840 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:34.568427 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-79b27cd2-8c44-4fe2-a4cc-522b1ff66840 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:34.583107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-79b27cd2-8c44-4fe2-a4cc-522b1ff66840 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:34.583395 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-79b27cd2-8c44-4fe2-a4cc-522b1ff66840 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:34.584222 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-79b27cd2-8c44-4fe2-a4cc-522b1ff66840 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:34.584653 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-79b27cd2-8c44-4fe2-a4cc-522b1ff66840 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:35.811883 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-79b27cd2-8c44-4fe2-a4cc-522b1ff66840 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:35.826650 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-79b27cd2-8c44-4fe2-a4cc-522b1ff66840 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1315 microversion: 2.1 time: 1.263518 Jun 06 13:08:35.832527 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 22/37] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:34 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1315 bytes in 1271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:36.851096 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dc6673a0-e086-451c-8534-2521f824e802 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:36.851853 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dc6673a0-e086-451c-8534-2521f824e802 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:36.855166 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:36.857527 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:36.898102 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc6673a0-e086-451c-8534-2521f824e802 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:36.901620 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc6673a0-e086-451c-8534-2521f824e802 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:36.906842 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc6673a0-e086-451c-8534-2521f824e802 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:36.908206 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc6673a0-e086-451c-8534-2521f824e802 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:38.075282 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dc6673a0-e086-451c-8534-2521f824e802 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:38.124132 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dc6673a0-e086-451c-8534-2521f824e802 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1315 microversion: 2.1 time: 1.275439 Jun 06 13:08:38.132509 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 16/38] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:36 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1315 bytes in 1287 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:39.141946 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-868a4492-3dfd-4e90-be35-0599ab8a8bd8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:39.142760 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-868a4492-3dfd-4e90-be35-0599ab8a8bd8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:39.145122 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=4 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:39.160064 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-868a4492-3dfd-4e90-be35-0599ab8a8bd8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:39.160729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-868a4492-3dfd-4e90-be35-0599ab8a8bd8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:39.161767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-868a4492-3dfd-4e90-be35-0599ab8a8bd8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:39.162407 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-868a4492-3dfd-4e90-be35-0599ab8a8bd8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:39.690759 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-868a4492-3dfd-4e90-be35-0599ab8a8bd8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:39.705380 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-868a4492-3dfd-4e90-be35-0599ab8a8bd8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1315 microversion: 2.1 time: 0.565230 Jun 06 13:08:39.706203 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 23/39] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:39 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1315 bytes in 569 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:40.080096 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-12db29d0-8d29-4cf9-bd35-11b0e9b76b7c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Action: 'create', calling method: .version_select at 0x7f0efc4a3dc0>, body: {"keypair": {"name": "tempest-keypair-1731660967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBDzZyb4x8ozuOOkHXQYCy6c+dDw8P9XdbCd89H92Wxt16GYWU64wRGVfHTCzpKB9riUQzT7GqTbpRKmOebyzQb1xIVNAgrjKocTMGZfhCbQ/IetEcB598xEoef4nc9Ka5A=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:40.084387 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-12db29d0-8d29-4cf9-bd35-11b0e9b76b7c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for project d6db503a0a1749789e92ed63f5a113b7. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:08:40.089287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-12db29d0-8d29-4cf9-bd35-11b0e9b76b7c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for user 9c620175b84d4cee9aef398864c03c8d and project d6db503a0a1749789e92ed63f5a113b7. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:08:40.320682 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-12db29d0-8d29-4cf9-bd35-11b0e9b76b7c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.795112 Jun 06 13:08:40.321449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 17/40] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 13:08:39 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 797 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:40.725368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-459bcda9-121d-440f-97ca-72758a39e266 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:40.726902 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-459bcda9-121d-440f-97ca-72758a39e266 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:40.752395 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-459bcda9-121d-440f-97ca-72758a39e266 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:40.752395 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-459bcda9-121d-440f-97ca-72758a39e266 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:40.757641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-459bcda9-121d-440f-97ca-72758a39e266 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:40.758564 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-459bcda9-121d-440f-97ca-72758a39e266 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:41.459788 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b355e678-26d3-44d9-8c38-cecd07581156 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Action: 'create', calling method: .version_select at 0x7f0efc4a3ee0>, body: {"keypair": {"name": "tempest-keypair-51552002", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBKPra74G5676kHWf/RFTGuet0hfepQywyqyqtHWTWNllAzGj6WgCK9vBTfhcT1JvQvCv4FjDbVHjrkKAJh+y/lI0k1ZYijYHqqU2IXy0TwBv47B/2VuOFzX8lrVmmBsKpg=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:41.520780 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-b355e678-26d3-44d9-8c38-cecd07581156 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Getting quotas for project 217a93e9314e4b06ae49a36a9969e22e. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:08:41.534364 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-b355e678-26d3-44d9-8c38-cecd07581156 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Getting quotas for user 15aec8f2f71e4084a21cc0cfc3a52bd2 and project 217a93e9314e4b06ae49a36a9969e22e. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:08:41.750476 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b355e678-26d3-44d9-8c38-cecd07581156 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 399 microversion: 2.20 time: 0.682547 Jun 06 13:08:41.758279 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 18/41] 10.222.0.13 () {62 vars in 1199 bytes} [Mon Jun 6 13:08:41 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 691 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 06 13:08:42.662578 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-749467876", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:42.873687 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] validate_networks() for [('057a1f64-b5b0-43c4-8588-382931d7cc3c', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:08:42.905680 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-459bcda9-121d-440f-97ca-72758a39e266 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:42.922454 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-459bcda9-121d-440f-97ca-72758a39e266 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1315 microversion: 2.1 time: 2.194143 Jun 06 13:08:42.937528 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 24/42] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:40 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1315 bytes in 2204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:43.280157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-6b19bf24-7597-49e8-a9e6-8003fab08755 req-052ce7df-58f8-4cf8-8392-38922d14bb1d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2ca237b6-d9b3-4420-92b7-91ae38b22019", "tag": "163f5462-d72e-4328-9007-6885d911502a"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:43.369860 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-6b19bf24-7597-49e8-a9e6-8003fab08755 req-052ce7df-58f8-4cf8-8392-38922d14bb1d service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:43.375334 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-6b19bf24-7597-49e8-a9e6-8003fab08755 req-052ce7df-58f8-4cf8-8392-38922d14bb1d service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:43.480341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-6b19bf24-7597-49e8-a9e6-8003fab08755 req-052ce7df-58f8-4cf8-8392-38922d14bb1d service nova] Creating event network-changed:163f5462-d72e-4328-9007-6885d911502a for instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 on hv-cinder-75510 Jun 06 13:08:43.481133 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-6b19bf24-7597-49e8-a9e6-8003fab08755 req-052ce7df-58f8-4cf8-8392-38922d14bb1d service nova] Acquired lock "compute-rpcapi-router" {{(pid=118134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 06 13:08:43.482543 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-24a86dca-a20b-45db-ada6-c065a10c4978 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:43.483135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-24a86dca-a20b-45db-ada6-c065a10c4978 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:43.485790 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-24a86dca-a20b-45db-ada6-c065a10c4978 None None] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:43.486420 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-24a86dca-a20b-45db-ada6-c065a10c4978 None None] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:43.509274 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.compute.rpcapi [None req-24a86dca-a20b-45db-ada6-c065a10c4978 None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 06 13:08:43.509274 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-24a86dca-a20b-45db-ada6-c065a10c4978 None None] Releasing lock "compute-rpcapi-router" {{(pid=118134) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 06 13:08:43.547143 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-24a86dca-a20b-45db-ada6-c065a10c4978 None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.620785 Jun 06 13:08:43.548288 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 25/43] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:08:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:44.144334 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ef50e8c8-2e63-4bf2-a221-e3995a9731bf tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Action: 'create', calling method: .version_select at 0x7f0efcd7d790>, body: {"keypair": {"name": "tempest-keypair-1193851189", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHJhFdRpIT2ZuIvQnfcNYbwYXIvy3F1gOx6vgFUzUhX2Cia7aSD7Gnie8RvewFY0y+WHJAR4oejpcln5kWuXL4UUiue1j33CIe27fDt2SwNH2oy/vGCtL4VgsiPred2glg=="}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:44.311451 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-ef50e8c8-2e63-4bf2-a221-e3995a9731bf tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Getting quotas for project 2b88389a00a342e285e0c31b90368f87. Resources: {'key_pairs'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:08:44.319809 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-ef50e8c8-2e63-4bf2-a221-e3995a9731bf tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Getting quotas for user 288ab671062d409f98b91aeacde8b5fc and project 2b88389a00a342e285e0c31b90368f87. Resources: {'key_pairs'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:08:44.468619 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ef50e8c8-2e63-4bf2-a221-e3995a9731bf tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.865266 Jun 06 13:08:44.469652 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 26/44] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 13:08:43 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 868 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:44.485410 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-990a430c-c08b-44d2-b8d8-2a5b5b2e99d9 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:44.486331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-990a430c-c08b-44d2-b8d8-2a5b5b2e99d9 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:44.521539 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-990a430c-c08b-44d2-b8d8-2a5b5b2e99d9 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:44.525815 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-990a430c-c08b-44d2-b8d8-2a5b5b2e99d9 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:44.530130 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-990a430c-c08b-44d2-b8d8-2a5b5b2e99d9 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:44.533527 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-990a430c-c08b-44d2-b8d8-2a5b5b2e99d9 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:45.563931 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-990a430c-c08b-44d2-b8d8-2a5b5b2e99d9 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:45.581364 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-990a430c-c08b-44d2-b8d8-2a5b5b2e99d9 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1315 microversion: 2.1 time: 1.102832 Jun 06 13:08:45.583514 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 27/45] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:44 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1315 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:46.601588 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2b901670-fcc4-4b44-9313-d11b14cf533e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:46.603152 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2b901670-fcc4-4b44-9313-d11b14cf533e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:46.621706 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:08:46.622699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:08:46.622785 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b901670-fcc4-4b44-9313-d11b14cf533e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:46.626876 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:08:46.626876 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:08:46.626876 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:08:46.627135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b901670-fcc4-4b44-9313-d11b14cf533e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:46.632428 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b901670-fcc4-4b44-9313-d11b14cf533e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:46.633163 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b901670-fcc4-4b44-9313-d11b14cf533e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:46.638512 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:46.638965 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:46.648542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:46.649068 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:46.710359 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Getting quotas for project d2263cfc378b4967ab4d2817991874f5. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:08:46.730397 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Getting quotas for user e8410e3632ec4908824d336fff667da5 and project d2263cfc378b4967ab4d2817991874f5. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:08:46.767572 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:08:46.770614 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:08:47.035811 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d35cc779-0507-4001-9890-c26a2c7b3f57 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 4.502229 Jun 06 13:08:47.055179 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 19/46] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:08:42 2022] POST /compute/v2.1/servers => generated 383 bytes in 4526 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:08:47.076566 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0a4bc72a-59cd-4d8d-9350-8f8122c6fe6f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:47.082283 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0a4bc72a-59cd-4d8d-9350-8f8122c6fe6f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:47.523107 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0a4bc72a-59cd-4d8d-9350-8f8122c6fe6f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:47.542263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0a4bc72a-59cd-4d8d-9350-8f8122c6fe6f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1221 microversion: 2.1 time: 0.484179 Jun 06 13:08:47.553613 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 20/47] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:47 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1221 bytes in 498 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:47.626984 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-2b901670-fcc4-4b44-9313-d11b14cf533e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:47.639431 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2b901670-fcc4-4b44-9313-d11b14cf533e tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1315 microversion: 2.1 time: 1.042476 Jun 06 13:08:47.652340 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 28/48] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:46 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1315 bytes in 1056 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:47.837358 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1126843023", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:48.011100 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] validate_networks() for [('057a1f64-b5b0-43c4-8588-382931d7cc3c', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:08:48.657516 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-95ae4b29-f276-4914-9618-1855fc92e762 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:48.658136 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-95ae4b29-f276-4914-9618-1855fc92e762 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:48.667118 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-95ae4b29-f276-4914-9618-1855fc92e762 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:48.669288 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-95ae4b29-f276-4914-9618-1855fc92e762 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:48.669288 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-95ae4b29-f276-4914-9618-1855fc92e762 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:48.669288 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-95ae4b29-f276-4914-9618-1855fc92e762 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:49.622482 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-95ae4b29-f276-4914-9618-1855fc92e762 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:49.636564 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-95ae4b29-f276-4914-9618-1855fc92e762 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1315 microversion: 2.1 time: 0.978773 Jun 06 13:08:49.640464 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 29/49] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:48 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1315 bytes in 988 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:08:50.045418 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-847642565", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47dfc8c5-ef77-41b0-a754-346b183b0265"}], "security_groups": [{"name": "tempest-securitygroup--1549268525"}], "key_name": "tempest-keypair-51552002", "user_data": "}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:50.080465 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:08:50.081684 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:08:50.082445 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:08:50.083034 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:08:50.083671 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:08:50.096330 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:50.097070 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:50.098134 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:50.098772 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:50.126372 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Getting quotas for project d2263cfc378b4967ab4d2817991874f5. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:08:50.131132 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Getting quotas for user e8410e3632ec4908824d336fff667da5 and project d2263cfc378b4967ab4d2817991874f5. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:08:50.157767 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:08:50.160399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:08:50.342452 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a1e4b298-1a58-4c1a-a749-bbd5cb26d603 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.511019 Jun 06 13:08:50.350384 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 21/50] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:08:47 2022] POST /compute/v2.1/servers => generated 383 bytes in 2516 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:08:50.359476 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3a41e85a-90d4-45a3-a37a-7ae263fbc910 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:50.370854 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3a41e85a-90d4-45a3-a37a-7ae263fbc910 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:50.641961 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.network.neutron [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] validate_networks() for [('47dfc8c5-ef77-41b0-a754-346b183b0265', None, None, None, None, None)] {{(pid=118134) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:08:50.649352 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3a41e85a-90d4-45a3-a37a-7ae263fbc910 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:50.666412 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3a41e85a-90d4-45a3-a37a-7ae263fbc910 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1222 microversion: 2.1 time: 0.309561 Jun 06 13:08:50.670758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 22/51] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:50 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1222 bytes in 316 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:50.679335 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-be114825-129d-4959-adae-7bff9b1fdc19 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:50.680783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-be114825-129d-4959-adae-7bff9b1fdc19 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:50.690288 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-be114825-129d-4959-adae-7bff9b1fdc19 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:50.693409 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-be114825-129d-4959-adae-7bff9b1fdc19 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:50.694280 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-be114825-129d-4959-adae-7bff9b1fdc19 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:50.731364 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-be114825-129d-4959-adae-7bff9b1fdc19 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.037s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:50.791781 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=28 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:51.633007 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-be114825-129d-4959-adae-7bff9b1fdc19 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:51.645797 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-be114825-129d-4959-adae-7bff9b1fdc19 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1315 microversion: 2.1 time: 0.971914 Jun 06 13:08:51.648911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 23/52] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:50 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1315 bytes in 978 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:51.693400 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5725f4df-e324-4e47-8d3a-3f591a219695 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:51.693400 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5725f4df-e324-4e47-8d3a-3f591a219695 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:51.704782 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=78,nova_api:INSERT=11 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:51.888165 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5725f4df-e324-4e47-8d3a-3f591a219695 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:51.896287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5725f4df-e324-4e47-8d3a-3f591a219695 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1222 microversion: 2.1 time: 0.218207 Jun 06 13:08:51.907908 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 24/53] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:51 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1222 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:08:51.945742 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1925065696", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e6b38e7-6e44-43bf-a66b-a75358de1034"}], "security_groups": [{"name": "tempest-securitygroup--140922562"}], "key_name": "tempest-keypair-1731660967", "user_data": "}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:52.263289 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] validate_networks() for [('2e6b38e7-6e44-43bf-a66b-a75358de1034', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:08:52.392366 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Flavor limits 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:08:52.392815 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Image limits 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:08:52.393139 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Flavor pref 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:08:52.393726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Image pref 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:08:52.394366 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:08:52.405232 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:52.406014 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:52.407181 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:52.407877 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:52.459031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=53 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:52.477355 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Getting quotas for project 217a93e9314e4b06ae49a36a9969e22e. Resources: {'cores', 'ram', 'instances'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:08:52.495046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=46,nova_api:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:08:52.497656 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Getting quotas for user 15aec8f2f71e4084a21cc0cfc3a52bd2 and project 217a93e9314e4b06ae49a36a9969e22e. Resources: {'cores', 'ram', 'instances'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:08:52.513139 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Going to run 1 instances... {{(pid=118134) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:08:52.516687 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:08:52.651772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-bcdfaf8c-552c-4f62-a3c6-3814856f45ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 2.612086 Jun 06 13:08:52.652822 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 30/54] 10.222.0.13 () {62 vars in 1187 bytes} [Mon Jun 6 13:08:50 2022] POST /compute/v2.1/servers => generated 402 bytes in 2614 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 06 13:08:52.659609 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-2005094560", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8be75cc5-d338-4e12-b1d6-bd98dfb35b62"}], "security_groups": [{"name": "tempest-securitygroup--1772123038"}], "key_name": "tempest-keypair-1193851189", "user_data": "}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:52.833347 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.network.neutron [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] validate_networks() for [('8be75cc5-d338-4e12-b1d6-bd98dfb35b62', None, None, None, None, None)] {{(pid=118134) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:08:53.094691 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:08:53.095252 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:08:53.095589 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:08:53.096000 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:08:53.096414 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:08:53.107361 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:53.107834 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:53.108872 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:53.109450 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:53.141862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for project d6db503a0a1749789e92ed63f5a113b7. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:08:53.146550 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for user 9c620175b84d4cee9aef398864c03c8d and project d6db503a0a1749789e92ed63f5a113b7. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:08:53.166391 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:08:53.169893 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:08:53.433364 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ab5c7376-3c4a-4d86-8c3a-4573f1a8e5ae tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.492404 Jun 06 13:08:53.437299 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 25/55] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:08:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 1497 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:08:53.447031 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1d2f1d26-b592-41b0-8fc7-98a6e54f48c3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:53.451241 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1d2f1d26-b592-41b0-8fc7-98a6e54f48c3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:53.680486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1d2f1d26-b592-41b0-8fc7-98a6e54f48c3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:53.690691 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1d2f1d26-b592-41b0-8fc7-98a6e54f48c3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:53.710248 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1d2f1d26-b592-41b0-8fc7-98a6e54f48c3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:53.712245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1d2f1d26-b592-41b0-8fc7-98a6e54f48c3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1279 microversion: 2.20 time: 0.272997 Jun 06 13:08:53.723618 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 26/56] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:08:53 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1279 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:08:53.723618 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4fb2a12d-5ebc-4df6-8239-0d0ebc7c39e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:53.723618 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4fb2a12d-5ebc-4df6-8239-0d0ebc7c39e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:53.730883 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4fb2a12d-5ebc-4df6-8239-0d0ebc7c39e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:53.731322 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4fb2a12d-5ebc-4df6-8239-0d0ebc7c39e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:53.732123 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4fb2a12d-5ebc-4df6-8239-0d0ebc7c39e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:53.732559 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4fb2a12d-5ebc-4df6-8239-0d0ebc7c39e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:53.790498 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Flavor limits 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:08:53.790985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Image limits 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:08:53.791388 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Flavor pref 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:08:53.791835 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Image pref 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:08:53.792255 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:08:53.802748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:53.803286 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:53.813340 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:53.813340 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:53.851387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Getting quotas for project 2b88389a00a342e285e0c31b90368f87. Resources: {'cores', 'ram', 'instances'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:08:53.855499 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Getting quotas for user 288ab671062d409f98b91aeacde8b5fc and project 2b88389a00a342e285e0c31b90368f87. Resources: {'cores', 'ram', 'instances'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:08:53.867441 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Going to run 1 instances... {{(pid=118134) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:08:53.869941 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:08:53.935220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4fb2a12d-5ebc-4df6-8239-0d0ebc7c39e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:53.945153 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4fb2a12d-5ebc-4df6-8239-0d0ebc7c39e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1315 microversion: 2.1 time: 0.228777 Jun 06 13:08:53.946146 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 27/57] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:53 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1315 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:53.952120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5ed26b94-55a7-4e66-8175-251982c27ea3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:53.953343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5ed26b94-55a7-4e66-8175-251982c27ea3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:53.961266 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5ed26b94-55a7-4e66-8175-251982c27ea3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:53.961783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5ed26b94-55a7-4e66-8175-251982c27ea3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:53.962569 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5ed26b94-55a7-4e66-8175-251982c27ea3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:53.963002 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5ed26b94-55a7-4e66-8175-251982c27ea3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:54.046572 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1a7bab0e-60d5-4556-b76f-98ebabf26641 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.391687 Jun 06 13:08:54.047223 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 31/58] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:08:52 2022] POST /compute/v2.1/servers => generated 402 bytes in 1394 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:08:54.062480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-98ee8e5e-acba-4d58-afca-1c0bc5d1e605 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:54.063109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-98ee8e5e-acba-4d58-afca-1c0bc5d1e605 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:54.081392 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5ed26b94-55a7-4e66-8175-251982c27ea3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:54.094603 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5ed26b94-55a7-4e66-8175-251982c27ea3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1274 microversion: 2.1 time: 0.147180 Jun 06 13:08:54.096137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 28/59] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:53 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1274 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:54.100927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0c66df5a-312c-4c93-a7bd-194be37d7c5a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:54.101739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0c66df5a-312c-4c93-a7bd-194be37d7c5a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:54.194877 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-98ee8e5e-acba-4d58-afca-1c0bc5d1e605 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:54.205159 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-98ee8e5e-acba-4d58-afca-1c0bc5d1e605 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1242 microversion: 2.1 time: 0.154037 Jun 06 13:08:54.225254 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0c66df5a-312c-4c93-a7bd-194be37d7c5a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:54.227786 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 32/60] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:54 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1242 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:54.241049 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0c66df5a-312c-4c93-a7bd-194be37d7c5a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1238 microversion: 2.1 time: 0.143640 Jun 06 13:08:54.243992 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 29/61] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:54 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1238 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:54.733205 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-14bb1acc-ed06-4bfb-9ae5-76b955cbe25b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:54.736220 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-14bb1acc-ed06-4bfb-9ae5-76b955cbe25b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:54.745063 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-14bb1acc-ed06-4bfb-9ae5-76b955cbe25b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:54.745767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-14bb1acc-ed06-4bfb-9ae5-76b955cbe25b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:54.748406 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-14bb1acc-ed06-4bfb-9ae5-76b955cbe25b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:54.749048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-14bb1acc-ed06-4bfb-9ae5-76b955cbe25b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:54.962124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dc220628-3d60-4138-a3eb-7697bb9719fe tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:54.962730 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dc220628-3d60-4138-a3eb-7697bb9719fe tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:54.983700 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc220628-3d60-4138-a3eb-7697bb9719fe tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:54.983700 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc220628-3d60-4138-a3eb-7697bb9719fe tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:54.984609 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc220628-3d60-4138-a3eb-7697bb9719fe tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:55.005463 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc220628-3d60-4138-a3eb-7697bb9719fe tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:55.189759 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-14bb1acc-ed06-4bfb-9ae5-76b955cbe25b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:55.208245 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-14bb1acc-ed06-4bfb-9ae5-76b955cbe25b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:55.214542 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-14bb1acc-ed06-4bfb-9ae5-76b955cbe25b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:55.216534 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-14bb1acc-ed06-4bfb-9ae5-76b955cbe25b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1283 microversion: 2.20 time: 0.488891 Jun 06 13:08:55.220262 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 33/62] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:08:54 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1283 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:08:55.247091 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-67558d30-fcea-41e1-b387-9a2a292ff141 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:55.252020 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-67558d30-fcea-41e1-b387-9a2a292ff141 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:55.281111 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67558d30-fcea-41e1-b387-9a2a292ff141 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:55.283813 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67558d30-fcea-41e1-b387-9a2a292ff141 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:55.284805 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67558d30-fcea-41e1-b387-9a2a292ff141 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:55.287274 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67558d30-fcea-41e1-b387-9a2a292ff141 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:55.447489 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-67558d30-fcea-41e1-b387-9a2a292ff141 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:55.466323 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-67558d30-fcea-41e1-b387-9a2a292ff141 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1292 microversion: 2.1 time: 0.244513 Jun 06 13:08:55.492805 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 34/63] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:55 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1292 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:55.521641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-15bcaee4-6914-43b0-8ece-7b257136b4ef tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:55.528598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-15bcaee4-6914-43b0-8ece-7b257136b4ef tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:55.557127 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-15bcaee4-6914-43b0-8ece-7b257136b4ef tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:55.557593 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-15bcaee4-6914-43b0-8ece-7b257136b4ef tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:55.559948 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-15bcaee4-6914-43b0-8ece-7b257136b4ef tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:55.560399 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-15bcaee4-6914-43b0-8ece-7b257136b4ef tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:55.799507 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dc220628-3d60-4138-a3eb-7697bb9719fe tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:55.816092 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dc220628-3d60-4138-a3eb-7697bb9719fe tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1315 microversion: 2.1 time: 0.854210 Jun 06 13:08:55.838103 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 30/64] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:54 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1315 bytes in 880 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:08:55.857170 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-73c393a6-4574-4b7d-b05d-e762e6ca9a9a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:55.859773 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-73c393a6-4574-4b7d-b05d-e762e6ca9a9a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:55.891305 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-15bcaee4-6914-43b0-8ece-7b257136b4ef tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:55.903743 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-15bcaee4-6914-43b0-8ece-7b257136b4ef tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1246 microversion: 2.1 time: 0.407871 Jun 06 13:08:55.906405 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 35/65] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:55 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1246 bytes in 413 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:56.039981 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-73c393a6-4574-4b7d-b05d-e762e6ca9a9a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:56.066406 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-73c393a6-4574-4b7d-b05d-e762e6ca9a9a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1238 microversion: 2.1 time: 0.215756 Jun 06 13:08:56.066406 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 31/66] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:55 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1238 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:56.243974 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-186160ab-5521-4cba-912f-e1f35d6fc928 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:56.244841 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-186160ab-5521-4cba-912f-e1f35d6fc928 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:56.251701 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-186160ab-5521-4cba-912f-e1f35d6fc928 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:56.252302 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-186160ab-5521-4cba-912f-e1f35d6fc928 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:56.253333 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-186160ab-5521-4cba-912f-e1f35d6fc928 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:56.253987 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-186160ab-5521-4cba-912f-e1f35d6fc928 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:56.325489 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-186160ab-5521-4cba-912f-e1f35d6fc928 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:56.345625 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-186160ab-5521-4cba-912f-e1f35d6fc928 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:56.353289 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-186160ab-5521-4cba-912f-e1f35d6fc928 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:56.361564 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-186160ab-5521-4cba-912f-e1f35d6fc928 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1339 microversion: 2.20 time: 0.114939 Jun 06 13:08:56.363226 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 36/67] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:08:56 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1339 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:08:56.488061 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bfc6bf4a-5b57-4918-8c37-13c87fbb1ee6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:56.488891 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bfc6bf4a-5b57-4918-8c37-13c87fbb1ee6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:56.499271 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bfc6bf4a-5b57-4918-8c37-13c87fbb1ee6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:56.503480 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bfc6bf4a-5b57-4918-8c37-13c87fbb1ee6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:56.503480 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bfc6bf4a-5b57-4918-8c37-13c87fbb1ee6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:56.503480 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bfc6bf4a-5b57-4918-8c37-13c87fbb1ee6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:56.688630 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bfc6bf4a-5b57-4918-8c37-13c87fbb1ee6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:56.719642 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bfc6bf4a-5b57-4918-8c37-13c87fbb1ee6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1280 microversion: 2.1 time: 0.236314 Jun 06 13:08:56.726884 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 32/68] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:56 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1280 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:56.834346 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-78012d82-0960-4061-9f4d-5e4e0f9d2e78 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:56.835660 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-78012d82-0960-4061-9f4d-5e4e0f9d2e78 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:56.854034 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-78012d82-0960-4061-9f4d-5e4e0f9d2e78 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:56.855889 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-78012d82-0960-4061-9f4d-5e4e0f9d2e78 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:56.863328 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-78012d82-0960-4061-9f4d-5e4e0f9d2e78 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:56.872750 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-78012d82-0960-4061-9f4d-5e4e0f9d2e78 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:56.922529 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-91fb5faf-f4c6-497c-bd83-62ebef110830 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:56.924046 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-91fb5faf-f4c6-497c-bd83-62ebef110830 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:56.934048 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-91fb5faf-f4c6-497c-bd83-62ebef110830 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:56.954295 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-91fb5faf-f4c6-497c-bd83-62ebef110830 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:56.955541 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-91fb5faf-f4c6-497c-bd83-62ebef110830 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:56.956595 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-91fb5faf-f4c6-497c-bd83-62ebef110830 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:57.174982 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-91fb5faf-f4c6-497c-bd83-62ebef110830 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:57.188179 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-91fb5faf-f4c6-497c-bd83-62ebef110830 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1302 microversion: 2.1 time: 0.267251 Jun 06 13:08:57.188920 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 33/69] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:56 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1302 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:57.196747 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e241ff20-46d3-46e8-8cd1-4746314e7274 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:57.202216 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e241ff20-46d3-46e8-8cd1-4746314e7274 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:57.215245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e241ff20-46d3-46e8-8cd1-4746314e7274 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:57.216069 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e241ff20-46d3-46e8-8cd1-4746314e7274 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:57.222026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e241ff20-46d3-46e8-8cd1-4746314e7274 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:57.222783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e241ff20-46d3-46e8-8cd1-4746314e7274 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:57.497787 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e241ff20-46d3-46e8-8cd1-4746314e7274 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:57.523925 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e241ff20-46d3-46e8-8cd1-4746314e7274 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1290 microversion: 2.1 time: 0.332924 Jun 06 13:08:57.539564 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 34/70] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:57 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1290 bytes in 347 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:57.549753 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f9b8ae22-52f1-4e6f-bfc9-81b7e0638659 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:57.556252 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f9b8ae22-52f1-4e6f-bfc9-81b7e0638659 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:57.564079 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f9b8ae22-52f1-4e6f-bfc9-81b7e0638659 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:57.564541 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f9b8ae22-52f1-4e6f-bfc9-81b7e0638659 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:57.565311 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f9b8ae22-52f1-4e6f-bfc9-81b7e0638659 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:57.566094 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f9b8ae22-52f1-4e6f-bfc9-81b7e0638659 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:57.693830 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f9b8ae22-52f1-4e6f-bfc9-81b7e0638659 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:57.711382 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f9b8ae22-52f1-4e6f-bfc9-81b7e0638659 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:57.716249 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-78012d82-0960-4061-9f4d-5e4e0f9d2e78 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:57.726845 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f9b8ae22-52f1-4e6f-bfc9-81b7e0638659 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:57.729852 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-78012d82-0960-4061-9f4d-5e4e0f9d2e78 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1315 microversion: 2.1 time: 0.899502 Jun 06 13:08:57.742200 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f9b8ae22-52f1-4e6f-bfc9-81b7e0638659 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1337 microversion: 2.20 time: 0.190418 Jun 06 13:08:57.743820 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 35/71] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:08:57 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1337 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:08:57.745569 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 37/72] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:56 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1315 bytes in 916 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:57.756798 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ca2c0637-75c7-4626-bb02-226b5839c954 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:57.758611 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ca2c0637-75c7-4626-bb02-226b5839c954 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:57.767180 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ca2c0637-75c7-4626-bb02-226b5839c954 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:57.767865 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ca2c0637-75c7-4626-bb02-226b5839c954 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:57.768854 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ca2c0637-75c7-4626-bb02-226b5839c954 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:57.769469 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ca2c0637-75c7-4626-bb02-226b5839c954 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:57.900974 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-47be4a5c-c4a7-44e4-82af-55263356a5e9 req-70e98e3e-45bf-4629-bf44-0846a07433e4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca237b6-d9b3-4420-92b7-91ae38b22019", "name": "network-vif-plugged", "status": "completed", "tag": "163f5462-d72e-4328-9007-6885d911502a"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:57.921039 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-47be4a5c-c4a7-44e4-82af-55263356a5e9 req-70e98e3e-45bf-4629-bf44-0846a07433e4 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:57.921489 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-47be4a5c-c4a7-44e4-82af-55263356a5e9 req-70e98e3e-45bf-4629-bf44-0846a07433e4 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:57.963993 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-47be4a5c-c4a7-44e4-82af-55263356a5e9 req-70e98e3e-45bf-4629-bf44-0846a07433e4 service nova] Creating event network-vif-plugged:163f5462-d72e-4328-9007-6885d911502a for instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 on hv-cinder-75510 Jun 06 13:08:57.967503 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-47be4a5c-c4a7-44e4-82af-55263356a5e9 req-70e98e3e-45bf-4629-bf44-0846a07433e4 service nova] Acquired lock "compute-rpcapi-router" {{(pid=118133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:294}} Jun 06 13:08:57.969717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cbbd91d6-0cdf-417e-b208-920f73efff1f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:57.970527 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cbbd91d6-0cdf-417e-b208-920f73efff1f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:57.971916 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cbbd91d6-0cdf-417e-b208-920f73efff1f None None] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:57.972498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cbbd91d6-0cdf-417e-b208-920f73efff1f None None] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:57.983582 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.compute.rpcapi [None req-cbbd91d6-0cdf-417e-b208-920f73efff1f None None] Automatically selected compute RPC version 6.0 from minimum service version 61 Jun 06 13:08:57.984802 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cbbd91d6-0cdf-417e-b208-920f73efff1f None None] Releasing lock "compute-rpcapi-router" {{(pid=118133) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Jun 06 13:08:58.021929 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cbbd91d6-0cdf-417e-b208-920f73efff1f None None] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.272213 Jun 06 13:08:58.022805 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 36/73] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:08:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 278 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:58.207594 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-36c5184a-797b-4c32-9fff-470dc8fa91d6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:58.208270 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-36c5184a-797b-4c32-9fff-470dc8fa91d6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:58.218837 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-36c5184a-797b-4c32-9fff-470dc8fa91d6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:58.218837 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-36c5184a-797b-4c32-9fff-470dc8fa91d6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:58.218837 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-36c5184a-797b-4c32-9fff-470dc8fa91d6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:58.219560 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-36c5184a-797b-4c32-9fff-470dc8fa91d6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:58.406133 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-36c5184a-797b-4c32-9fff-470dc8fa91d6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:58.422032 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-36c5184a-797b-4c32-9fff-470dc8fa91d6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1300 microversion: 2.1 time: 0.218516 Jun 06 13:08:58.423126 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 37/74] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:58 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1300 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:08:58.516968 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ca2c0637-75c7-4626-bb02-226b5839c954 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:58.524725 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ca2c0637-75c7-4626-bb02-226b5839c954 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1322 microversion: 2.1 time: 0.777892 Jun 06 13:08:58.525584 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 38/75] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:57 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1322 bytes in 779 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:58.546010 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7ec186a3-ccf8-49b0-9f67-7cb0eb8225c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:58.546622 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7ec186a3-ccf8-49b0-9f67-7cb0eb8225c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:58.552687 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ec186a3-ccf8-49b0-9f67-7cb0eb8225c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:58.553141 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ec186a3-ccf8-49b0-9f67-7cb0eb8225c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:58.553910 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ec186a3-ccf8-49b0-9f67-7cb0eb8225c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:58.554385 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ec186a3-ccf8-49b0-9f67-7cb0eb8225c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:58.677838 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7ec186a3-ccf8-49b0-9f67-7cb0eb8225c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:58.700486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7ec186a3-ccf8-49b0-9f67-7cb0eb8225c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1296 microversion: 2.1 time: 0.158626 Jun 06 13:08:58.705673 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 38/76] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:58 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1296 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:58.751889 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ca3f2679-46c1-4cda-9b89-e1ddc3343cdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:58.752706 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ca3f2679-46c1-4cda-9b89-e1ddc3343cdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:58.766100 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-410e5106-9506-4a94-8b68-a9a5c09fd3aa tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:58.768248 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-410e5106-9506-4a94-8b68-a9a5c09fd3aa tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:58.790272 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ca3f2679-46c1-4cda-9b89-e1ddc3343cdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:58.791860 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ca3f2679-46c1-4cda-9b89-e1ddc3343cdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:58.795967 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ca3f2679-46c1-4cda-9b89-e1ddc3343cdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:58.797034 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ca3f2679-46c1-4cda-9b89-e1ddc3343cdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:58.803572 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-410e5106-9506-4a94-8b68-a9a5c09fd3aa tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:58.806864 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-410e5106-9506-4a94-8b68-a9a5c09fd3aa tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:58.824664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-410e5106-9506-4a94-8b68-a9a5c09fd3aa tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.014s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:58.837368 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-410e5106-9506-4a94-8b68-a9a5c09fd3aa tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:58.940500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ca3f2679-46c1-4cda-9b89-e1ddc3343cdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:58.957818 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ca3f2679-46c1-4cda-9b89-e1ddc3343cdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:58.960301 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ca3f2679-46c1-4cda-9b89-e1ddc3343cdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:58.962292 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ca3f2679-46c1-4cda-9b89-e1ddc3343cdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1337 microversion: 2.20 time: 0.216385 Jun 06 13:08:58.965380 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 39/77] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:08:58 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1337 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:08:59.224161 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-410e5106-9506-4a94-8b68-a9a5c09fd3aa tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:59.234976 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-410e5106-9506-4a94-8b68-a9a5c09fd3aa tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1315 microversion: 2.1 time: 0.478429 Jun 06 13:08:59.247629 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 39/78] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:58 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1315 bytes in 492 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:08:59.351813 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-e3873e83-fc99-45cd-98b1-b24b03a1a50c req-35ea7c91-2b00-47a2-8f49-ee33f663d257 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5c50c488-a0ae-4331-9dfe-5fb0b7ab5108", "tag": "2afcefdf-f52a-4b50-9bf5-21e35aed0ff2"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:08:59.367672 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-e3873e83-fc99-45cd-98b1-b24b03a1a50c req-35ea7c91-2b00-47a2-8f49-ee33f663d257 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:59.377321 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-e3873e83-fc99-45cd-98b1-b24b03a1a50c req-35ea7c91-2b00-47a2-8f49-ee33f663d257 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:59.415652 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-e3873e83-fc99-45cd-98b1-b24b03a1a50c req-35ea7c91-2b00-47a2-8f49-ee33f663d257 service nova] Creating event network-changed:2afcefdf-f52a-4b50-9bf5-21e35aed0ff2 for instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 on hv-cinder-75510 Jun 06 13:08:59.422543 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-e3873e83-fc99-45cd-98b1-b24b03a1a50c req-35ea7c91-2b00-47a2-8f49-ee33f663d257 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.074592 Jun 06 13:08:59.423212 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 40/79] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:08:59 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:08:59.440825 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-63d6a5b1-b108-449d-be13-53496eee424a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:59.441665 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-63d6a5b1-b108-449d-be13-53496eee424a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:59.450098 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-63d6a5b1-b108-449d-be13-53496eee424a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:59.450896 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-63d6a5b1-b108-449d-be13-53496eee424a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:59.451923 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-63d6a5b1-b108-449d-be13-53496eee424a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:59.452522 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-63d6a5b1-b108-449d-be13-53496eee424a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:59.543760 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4d7596cf-e7c0-4950-b599-08d5d9a47d7f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:08:59.544469 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-4d7596cf-e7c0-4950-b599-08d5d9a47d7f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:08:59.561988 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4d7596cf-e7c0-4950-b599-08d5d9a47d7f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:59.562448 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4d7596cf-e7c0-4950-b599-08d5d9a47d7f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:59.563238 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4d7596cf-e7c0-4950-b599-08d5d9a47d7f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:08:59.563711 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4d7596cf-e7c0-4950-b599-08d5d9a47d7f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:08:59.968321 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-63d6a5b1-b108-449d-be13-53496eee424a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:08:59.979488 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-63d6a5b1-b108-449d-be13-53496eee424a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.542591 Jun 06 13:08:59.996505 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 40/80] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:59 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 560 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:00.008174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7757d915-246c-4510-b510-a5cfc4cb4fe7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:00.009192 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7757d915-246c-4510-b510-a5cfc4cb4fe7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:00.033812 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7757d915-246c-4510-b510-a5cfc4cb4fe7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:00.036764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7757d915-246c-4510-b510-a5cfc4cb4fe7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:00.037991 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7757d915-246c-4510-b510-a5cfc4cb4fe7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:00.038673 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7757d915-246c-4510-b510-a5cfc4cb4fe7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:00.126906 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-4d7596cf-e7c0-4950-b599-08d5d9a47d7f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:00.135269 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-4d7596cf-e7c0-4950-b599-08d5d9a47d7f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1322 microversion: 2.1 time: 0.596053 Jun 06 13:09:00.147319 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 41/81] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:59 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1322 bytes in 609 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:00.153724 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-94644465-97df-4281-b663-4beb7b611a42 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:00.154640 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-94644465-97df-4281-b663-4beb7b611a42 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:00.163939 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-94644465-97df-4281-b663-4beb7b611a42 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:00.164802 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-94644465-97df-4281-b663-4beb7b611a42 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:00.166188 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-94644465-97df-4281-b663-4beb7b611a42 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:00.166898 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-94644465-97df-4281-b663-4beb7b611a42 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:00.303601 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7757d915-246c-4510-b510-a5cfc4cb4fe7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:00.316127 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7757d915-246c-4510-b510-a5cfc4cb4fe7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1296 microversion: 2.1 time: 0.313901 Jun 06 13:09:00.316678 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 41/82] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:08:59 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1296 bytes in 319 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:00.337520 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0fb9dd00-1cc2-440f-9f8d-2d36bb57ac9a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:00.338805 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0fb9dd00-1cc2-440f-9f8d-2d36bb57ac9a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:00.352443 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0fb9dd00-1cc2-440f-9f8d-2d36bb57ac9a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:00.353156 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0fb9dd00-1cc2-440f-9f8d-2d36bb57ac9a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:00.357551 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0fb9dd00-1cc2-440f-9f8d-2d36bb57ac9a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:00.377847 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0fb9dd00-1cc2-440f-9f8d-2d36bb57ac9a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:00.645499 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-94644465-97df-4281-b663-4beb7b611a42 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:00.659836 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-94644465-97df-4281-b663-4beb7b611a42 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:00.663295 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-94644465-97df-4281-b663-4beb7b611a42 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:00.664588 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-94644465-97df-4281-b663-4beb7b611a42 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.515856 Jun 06 13:09:00.666068 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 42/83] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:00 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 518 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:00.773381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0fb9dd00-1cc2-440f-9f8d-2d36bb57ac9a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:00.784501 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0fb9dd00-1cc2-440f-9f8d-2d36bb57ac9a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1315 microversion: 2.1 time: 0.462334 Jun 06 13:09:00.786071 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 42/84] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:00 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1315 bytes in 469 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:00.998724 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-11609284-dc66-4d51-96f0-35e2ba9356c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:00.999356 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-11609284-dc66-4d51-96f0-35e2ba9356c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:01.010433 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-11609284-dc66-4d51-96f0-35e2ba9356c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:01.010941 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-11609284-dc66-4d51-96f0-35e2ba9356c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:01.014855 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-11609284-dc66-4d51-96f0-35e2ba9356c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:01.015587 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-11609284-dc66-4d51-96f0-35e2ba9356c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:01.154724 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-de57efc6-64f8-4464-aef6-6fff8d6af737 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:01.155366 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-de57efc6-64f8-4464-aef6-6fff8d6af737 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:01.168771 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de57efc6-64f8-4464-aef6-6fff8d6af737 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:01.169331 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de57efc6-64f8-4464-aef6-6fff8d6af737 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:01.178303 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de57efc6-64f8-4464-aef6-6fff8d6af737 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:01.178763 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de57efc6-64f8-4464-aef6-6fff8d6af737 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:01.660901 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-de57efc6-64f8-4464-aef6-6fff8d6af737 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:01.684735 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-de57efc6-64f8-4464-aef6-6fff8d6af737 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1322 microversion: 2.1 time: 0.521646 Jun 06 13:09:01.687701 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 43/85] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:01 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1322 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:01.703457 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-95470ca1-f086-4e4a-8c23-14ff4bdd3041 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:01.716256 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-95470ca1-f086-4e4a-8c23-14ff4bdd3041 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:01.724947 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-95470ca1-f086-4e4a-8c23-14ff4bdd3041 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:01.725781 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-95470ca1-f086-4e4a-8c23-14ff4bdd3041 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:01.726826 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-95470ca1-f086-4e4a-8c23-14ff4bdd3041 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:01.727416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-95470ca1-f086-4e4a-8c23-14ff4bdd3041 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:01.917535 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-11609284-dc66-4d51-96f0-35e2ba9356c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:01.932747 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-11609284-dc66-4d51-96f0-35e2ba9356c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.937230 Jun 06 13:09:01.935062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 43/86] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:00 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 942 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:02.172796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-95470ca1-f086-4e4a-8c23-14ff4bdd3041 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:02.180565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-95470ca1-f086-4e4a-8c23-14ff4bdd3041 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.489742 Jun 06 13:09:02.188282 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-a932af59-8ce0-4e34-b5cb-ba13d10ecfeb req-28c0c0ce-cb43-438f-ade5-bc9aa7258199 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a52d4675-f6b5-4381-a005-d9ba7c7c4b90", "tag": "5d6dcaaf-ad13-4769-b8b2-14bbc7134365"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:09:02.192436 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 44/87] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:01 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:02.197255 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a33168e6-4c4e-411f-9fe7-459c046d85aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:02.197632 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-a932af59-8ce0-4e34-b5cb-ba13d10ecfeb req-28c0c0ce-cb43-438f-ade5-bc9aa7258199 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:02.198149 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-a932af59-8ce0-4e34-b5cb-ba13d10ecfeb req-28c0c0ce-cb43-438f-ade5-bc9aa7258199 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:02.198353 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a33168e6-4c4e-411f-9fe7-459c046d85aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:02.206833 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a33168e6-4c4e-411f-9fe7-459c046d85aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:02.207278 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a33168e6-4c4e-411f-9fe7-459c046d85aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:02.210833 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-a932af59-8ce0-4e34-b5cb-ba13d10ecfeb req-28c0c0ce-cb43-438f-ade5-bc9aa7258199 service nova] Creating event network-changed:5d6dcaaf-ad13-4769-b8b2-14bbc7134365 for instance a52d4675-f6b5-4381-a005-d9ba7c7c4b90 on hv-cinder-75510 Jun 06 13:09:02.212628 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a33168e6-4c4e-411f-9fe7-459c046d85aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:02.213533 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a33168e6-4c4e-411f-9fe7-459c046d85aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:02.217242 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-a932af59-8ce0-4e34-b5cb-ba13d10ecfeb req-28c0c0ce-cb43-438f-ade5-bc9aa7258199 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.266357 Jun 06 13:09:02.218195 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 44/88] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:09:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:09:02.224249 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5ba0ef9c-8133-48d8-9235-89406c84063d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:02.224953 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5ba0ef9c-8133-48d8-9235-89406c84063d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:02.232427 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5ba0ef9c-8133-48d8-9235-89406c84063d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:02.232872 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5ba0ef9c-8133-48d8-9235-89406c84063d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:02.233841 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5ba0ef9c-8133-48d8-9235-89406c84063d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:02.234495 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5ba0ef9c-8133-48d8-9235-89406c84063d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:02.243943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:02.619742 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5ba0ef9c-8133-48d8-9235-89406c84063d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:02.626149 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a33168e6-4c4e-411f-9fe7-459c046d85aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:02.630473 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5ba0ef9c-8133-48d8-9235-89406c84063d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1502 microversion: 2.1 time: 0.411011 Jun 06 13:09:02.631424 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 45/89] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:02 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1502 bytes in 412 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:02.641455 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a33168e6-4c4e-411f-9fe7-459c046d85aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:02.643429 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a33168e6-4c4e-411f-9fe7-459c046d85aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:02.648349 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a33168e6-4c4e-411f-9fe7-459c046d85aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.454687 Jun 06 13:09:02.649668 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 45/90] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:02 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 456 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:02.707490 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-33a0ce9e-5edb-4f62-94c7-fba7f1617c09 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:02.711105 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-33a0ce9e-5edb-4f62-94c7-fba7f1617c09 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:02.723146 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-33a0ce9e-5edb-4f62-94c7-fba7f1617c09 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:02.723812 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-33a0ce9e-5edb-4f62-94c7-fba7f1617c09 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:02.725431 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-33a0ce9e-5edb-4f62-94c7-fba7f1617c09 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:02.726028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-33a0ce9e-5edb-4f62-94c7-fba7f1617c09 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:02.951762 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-72d0b8fc-6906-4563-ab07-23767c47f7ca tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:02.952455 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-72d0b8fc-6906-4563-ab07-23767c47f7ca tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:02.972075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72d0b8fc-6906-4563-ab07-23767c47f7ca tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:02.972796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72d0b8fc-6906-4563-ab07-23767c47f7ca tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:02.973792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72d0b8fc-6906-4563-ab07-23767c47f7ca tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:02.974233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-72d0b8fc-6906-4563-ab07-23767c47f7ca tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:03.161637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-33a0ce9e-5edb-4f62-94c7-fba7f1617c09 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:03.169320 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-33a0ce9e-5edb-4f62-94c7-fba7f1617c09 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1322 microversion: 2.1 time: 0.468380 Jun 06 13:09:03.170065 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 46/91] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:02 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1322 bytes in 470 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:03.209089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1cf30ef2-8c72-4686-91dd-4a4c53d775a4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:03.209872 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1cf30ef2-8c72-4686-91dd-4a4c53d775a4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:03.218486 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1cf30ef2-8c72-4686-91dd-4a4c53d775a4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:03.219133 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1cf30ef2-8c72-4686-91dd-4a4c53d775a4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:03.222386 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1cf30ef2-8c72-4686-91dd-4a4c53d775a4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:03.222844 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1cf30ef2-8c72-4686-91dd-4a4c53d775a4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:03.551140 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-72d0b8fc-6906-4563-ab07-23767c47f7ca tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:03.593133 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-72d0b8fc-6906-4563-ab07-23767c47f7ca tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.644482 Jun 06 13:09:03.596561 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 46/92] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:02 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 650 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:03.609871 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-bc8ebc9b-d4ec-4366-a354-3feccaa4e82b req-8e6b036e-b268-4bfd-b72e-ae5ff165d7ec service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec960d68-c9a5-4886-a3f3-07c63abf3cce", "tag": "cbf0dd9f-4c61-43db-b99d-07520fba79b9"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:09:03.618489 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-bc8ebc9b-d4ec-4366-a354-3feccaa4e82b req-8e6b036e-b268-4bfd-b72e-ae5ff165d7ec service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:03.619189 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-bc8ebc9b-d4ec-4366-a354-3feccaa4e82b req-8e6b036e-b268-4bfd-b72e-ae5ff165d7ec service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:03.638165 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-bc8ebc9b-d4ec-4366-a354-3feccaa4e82b req-8e6b036e-b268-4bfd-b72e-ae5ff165d7ec service nova] Creating event network-changed:cbf0dd9f-4c61-43db-b99d-07520fba79b9 for instance ec960d68-c9a5-4886-a3f3-07c63abf3cce on hv-cinder-75510 Jun 06 13:09:03.640659 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1cf30ef2-8c72-4686-91dd-4a4c53d775a4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:03.640867 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-bc8ebc9b-d4ec-4366-a354-3feccaa4e82b req-8e6b036e-b268-4bfd-b72e-ae5ff165d7ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039105 Jun 06 13:09:03.642128 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 47/93] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:09:03 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:09:03.653135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1cf30ef2-8c72-4686-91dd-4a4c53d775a4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.447483 Jun 06 13:09:03.663800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 47/94] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:03 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 451 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:03.691475 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c6d219f2-ed50-41a9-835f-87c4be2926e3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:03.692359 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c6d219f2-ed50-41a9-835f-87c4be2926e3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:03.714793 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6d219f2-ed50-41a9-835f-87c4be2926e3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:03.714793 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6d219f2-ed50-41a9-835f-87c4be2926e3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:03.714793 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6d219f2-ed50-41a9-835f-87c4be2926e3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:03.714793 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6d219f2-ed50-41a9-835f-87c4be2926e3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:03.984927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c6d219f2-ed50-41a9-835f-87c4be2926e3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:03.993235 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c6d219f2-ed50-41a9-835f-87c4be2926e3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:03.994754 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c6d219f2-ed50-41a9-835f-87c4be2926e3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:03.996589 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c6d219f2-ed50-41a9-835f-87c4be2926e3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.318547 Jun 06 13:09:03.997183 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 48/95] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:03 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 320 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:04.187083 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a60ac240-028f-4171-830a-ea994a85370f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:04.187725 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a60ac240-028f-4171-830a-ea994a85370f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:04.189751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=6 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:04.194570 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a60ac240-028f-4171-830a-ea994a85370f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:04.195015 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a60ac240-028f-4171-830a-ea994a85370f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:04.195801 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a60ac240-028f-4171-830a-ea994a85370f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:04.196399 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a60ac240-028f-4171-830a-ea994a85370f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:04.200605 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=18 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:04.336433 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a60ac240-028f-4171-830a-ea994a85370f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:04.344441 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a60ac240-028f-4171-830a-ea994a85370f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1322 microversion: 2.1 time: 0.162062 Jun 06 13:09:04.345025 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 48/96] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:04 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1322 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:04.410196 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-2a2068dd-59b4-44a7-89e4-4c82589ef6f7 req-7893b54f-32e0-42c7-b4ff-dd1cb3b12cfe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc5ce11-0a01-44fd-9be7-c095a8254551", "tag": "5fd26d76-0c93-4177-8c73-21f7779282ef"}, {"name": "network-changed", "server_uuid": "05c0144f-361b-4c15-813d-6c7b190ff600", "tag": "39a2bbdc-cbb4-47cf-8e60-ceacd2a33a82"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:09:04.419459 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-2a2068dd-59b4-44a7-89e4-4c82589ef6f7 req-7893b54f-32e0-42c7-b4ff-dd1cb3b12cfe service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:04.419932 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-2a2068dd-59b4-44a7-89e4-4c82589ef6f7 req-7893b54f-32e0-42c7-b4ff-dd1cb3b12cfe service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:04.431665 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-2a2068dd-59b4-44a7-89e4-4c82589ef6f7 req-7893b54f-32e0-42c7-b4ff-dd1cb3b12cfe service nova] Creating event network-changed:5fd26d76-0c93-4177-8c73-21f7779282ef for instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 on hv-cinder-75510 Jun 06 13:09:04.432164 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-2a2068dd-59b4-44a7-89e4-4c82589ef6f7 req-7893b54f-32e0-42c7-b4ff-dd1cb3b12cfe service nova] Creating event network-changed:39a2bbdc-cbb4-47cf-8e60-ceacd2a33a82 for instance 05c0144f-361b-4c15-813d-6c7b190ff600 on hv-cinder-75510 Jun 06 13:09:04.439435 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-2a2068dd-59b4-44a7-89e4-4c82589ef6f7 req-7893b54f-32e0-42c7-b4ff-dd1cb3b12cfe service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.032805 Jun 06 13:09:04.440136 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 49/97] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:09:04 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:09:04.614371 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1e733ce3-f3c2-42e4-b663-487478c67576 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:04.615191 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1e733ce3-f3c2-42e4-b663-487478c67576 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:04.623072 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1e733ce3-f3c2-42e4-b663-487478c67576 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:04.623845 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1e733ce3-f3c2-42e4-b663-487478c67576 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:04.624978 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1e733ce3-f3c2-42e4-b663-487478c67576 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:04.625606 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1e733ce3-f3c2-42e4-b663-487478c67576 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:04.672358 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8acd0561-89a8-4eb1-af66-d40c5fda34c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:04.673499 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8acd0561-89a8-4eb1-af66-d40c5fda34c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:04.681580 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8acd0561-89a8-4eb1-af66-d40c5fda34c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:04.682323 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8acd0561-89a8-4eb1-af66-d40c5fda34c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:04.684016 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8acd0561-89a8-4eb1-af66-d40c5fda34c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:04.684657 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8acd0561-89a8-4eb1-af66-d40c5fda34c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:05.144046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1e733ce3-f3c2-42e4-b663-487478c67576 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:05.152605 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1e733ce3-f3c2-42e4-b663-487478c67576 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.542357 Jun 06 13:09:05.158772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 49/98] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:04 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 547 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:05.175064 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8acd0561-89a8-4eb1-af66-d40c5fda34c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:05.181781 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3cc47d35-8df1-4276-af63-660e2d6c5cde tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a23665f4-2c83-46d9-b29d-494a8acce016"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:09:05.186118 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3cc47d35-8df1-4276-af63-660e2d6c5cde tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:05.193709 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8acd0561-89a8-4eb1-af66-d40c5fda34c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.521292 Jun 06 13:09:05.193709 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 50/99] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:04 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:05.193709 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5cd8f459-bfd7-4218-8815-4de5bc3f97b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:05.194391 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5cd8f459-bfd7-4218-8815-4de5bc3f97b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:05.201254 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3cc47d35-8df1-4276-af63-660e2d6c5cde tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:05.201741 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3cc47d35-8df1-4276-af63-660e2d6c5cde tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:05.206621 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cd8f459-bfd7-4218-8815-4de5bc3f97b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:05.207235 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cd8f459-bfd7-4218-8815-4de5bc3f97b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:05.209025 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cd8f459-bfd7-4218-8815-4de5bc3f97b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:05.209645 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5cd8f459-bfd7-4218-8815-4de5bc3f97b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:05.210308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3cc47d35-8df1-4276-af63-660e2d6c5cde tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:05.211769 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3cc47d35-8df1-4276-af63-660e2d6c5cde tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:05.292638 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=100 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:05.564230 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5cd8f459-bfd7-4218-8815-4de5bc3f97b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:05.572318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5cd8f459-bfd7-4218-8815-4de5bc3f97b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:05.574862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5cd8f459-bfd7-4218-8815-4de5bc3f97b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:05.576251 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5cd8f459-bfd7-4218-8815-4de5bc3f97b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.386639 Jun 06 13:09:05.576824 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 51/100] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:05 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:05.581760 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4e6e1217-742f-4c48-a1da-9f7087bfd82e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:05.582361 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4e6e1217-742f-4c48-a1da-9f7087bfd82e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:05.592318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e6e1217-742f-4c48-a1da-9f7087bfd82e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:05.592768 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e6e1217-742f-4c48-a1da-9f7087bfd82e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:05.593529 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e6e1217-742f-4c48-a1da-9f7087bfd82e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:05.593962 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e6e1217-742f-4c48-a1da-9f7087bfd82e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:05.737210 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4e6e1217-742f-4c48-a1da-9f7087bfd82e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:05.744864 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4e6e1217-742f-4c48-a1da-9f7087bfd82e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1322 microversion: 2.1 time: 0.166995 Jun 06 13:09:05.746110 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 52/101] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:05 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1322 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:06.171154 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4ce11e21-9d31-4f8f-85c2-ed44445bb968 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:06.172174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4ce11e21-9d31-4f8f-85c2-ed44445bb968 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:06.174467 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=38 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:06.179821 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4ce11e21-9d31-4f8f-85c2-ed44445bb968 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:06.180365 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4ce11e21-9d31-4f8f-85c2-ed44445bb968 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:06.181078 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4ce11e21-9d31-4f8f-85c2-ed44445bb968 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:06.181555 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4ce11e21-9d31-4f8f-85c2-ed44445bb968 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:06.321844 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4ce11e21-9d31-4f8f-85c2-ed44445bb968 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:06.330405 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4ce11e21-9d31-4f8f-85c2-ed44445bb968 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.163917 Jun 06 13:09:06.331503 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 53/102] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:06 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:06.336464 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-12ff00e9-4e1e-40df-afa6-5f0963cd9440 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:06.337068 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-12ff00e9-4e1e-40df-afa6-5f0963cd9440 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:06.343981 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12ff00e9-4e1e-40df-afa6-5f0963cd9440 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:06.344711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12ff00e9-4e1e-40df-afa6-5f0963cd9440 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:06.345689 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12ff00e9-4e1e-40df-afa6-5f0963cd9440 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:06.346216 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12ff00e9-4e1e-40df-afa6-5f0963cd9440 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:06.480028 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-12ff00e9-4e1e-40df-afa6-5f0963cd9440 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:06.487839 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-12ff00e9-4e1e-40df-afa6-5f0963cd9440 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.155065 Jun 06 13:09:06.488409 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 54/103] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:06 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:06.595417 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-315585d9-714f-4aae-a93e-72becd089e20 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:06.596058 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-315585d9-714f-4aae-a93e-72becd089e20 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:06.602693 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-315585d9-714f-4aae-a93e-72becd089e20 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:06.603143 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-315585d9-714f-4aae-a93e-72becd089e20 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:06.603955 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-315585d9-714f-4aae-a93e-72becd089e20 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:06.604391 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-315585d9-714f-4aae-a93e-72becd089e20 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:06.753531 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-315585d9-714f-4aae-a93e-72becd089e20 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:06.764024 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-315585d9-714f-4aae-a93e-72becd089e20 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:06.765800 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-315585d9-714f-4aae-a93e-72becd089e20 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:06.766920 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-315585d9-714f-4aae-a93e-72becd089e20 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.175685 Jun 06 13:09:06.767475 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 55/104] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:06 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:06.772275 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e52cd1f8-dd0a-4a6d-be71-ca32a2f1ba26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:06.773076 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e52cd1f8-dd0a-4a6d-be71-ca32a2f1ba26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:06.780053 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e52cd1f8-dd0a-4a6d-be71-ca32a2f1ba26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:06.780922 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e52cd1f8-dd0a-4a6d-be71-ca32a2f1ba26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:06.781896 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e52cd1f8-dd0a-4a6d-be71-ca32a2f1ba26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:06.782634 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e52cd1f8-dd0a-4a6d-be71-ca32a2f1ba26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:06.933233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e52cd1f8-dd0a-4a6d-be71-ca32a2f1ba26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:06.941434 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e52cd1f8-dd0a-4a6d-be71-ca32a2f1ba26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1322 microversion: 2.1 time: 0.172750 Jun 06 13:09:06.942284 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 56/105] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:06 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1322 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:07.348419 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ae4bcad8-b98e-4db1-9b62-458b29371436 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:07.349085 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ae4bcad8-b98e-4db1-9b62-458b29371436 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:07.355182 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ae4bcad8-b98e-4db1-9b62-458b29371436 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:07.355666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ae4bcad8-b98e-4db1-9b62-458b29371436 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:07.356462 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ae4bcad8-b98e-4db1-9b62-458b29371436 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:07.356890 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ae4bcad8-b98e-4db1-9b62-458b29371436 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:07.506483 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ae4bcad8-b98e-4db1-9b62-458b29371436 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:07.516783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ae4bcad8-b98e-4db1-9b62-458b29371436 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.172060 Jun 06 13:09:07.528099 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 57/106] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:07 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:07.536850 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7a011cd7-f14e-4547-8362-07937e05d438 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:07.538467 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7a011cd7-f14e-4547-8362-07937e05d438 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:07.546758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a011cd7-f14e-4547-8362-07937e05d438 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:07.547301 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a011cd7-f14e-4547-8362-07937e05d438 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:07.548222 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a011cd7-f14e-4547-8362-07937e05d438 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:07.548858 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a011cd7-f14e-4547-8362-07937e05d438 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:07.692685 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7a011cd7-f14e-4547-8362-07937e05d438 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:07.701716 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7a011cd7-f14e-4547-8362-07937e05d438 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.171878 Jun 06 13:09:07.702455 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 58/107] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:07 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:07.786421 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1ab92af4-5701-4789-b625-e0871357792f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:07.787055 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1ab92af4-5701-4789-b625-e0871357792f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:07.793369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ab92af4-5701-4789-b625-e0871357792f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:07.793896 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ab92af4-5701-4789-b625-e0871357792f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:07.794572 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ab92af4-5701-4789-b625-e0871357792f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:07.795308 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1ab92af4-5701-4789-b625-e0871357792f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:07.956401 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1ab92af4-5701-4789-b625-e0871357792f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:07.971124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1ab92af4-5701-4789-b625-e0871357792f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:07.973574 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1ab92af4-5701-4789-b625-e0871357792f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:07.975124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1ab92af4-5701-4789-b625-e0871357792f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.192730 Jun 06 13:09:07.986729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 59/108] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:07 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:09:07.986729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=8 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:07.992552 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cee3f8dd-9eb9-4c29-a8c8-90c62a48faf3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:07.993657 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cee3f8dd-9eb9-4c29-a8c8-90c62a48faf3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:08.000488 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cee3f8dd-9eb9-4c29-a8c8-90c62a48faf3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:08.000942 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cee3f8dd-9eb9-4c29-a8c8-90c62a48faf3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:08.003563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cee3f8dd-9eb9-4c29-a8c8-90c62a48faf3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:08.003563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cee3f8dd-9eb9-4c29-a8c8-90c62a48faf3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:08.165354 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cee3f8dd-9eb9-4c29-a8c8-90c62a48faf3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:08.174339 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cee3f8dd-9eb9-4c29-a8c8-90c62a48faf3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1322 microversion: 2.1 time: 0.194941 Jun 06 13:09:08.175084 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 60/109] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:07 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1322 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:08.501432 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3cc47d35-8df1-4276-af63-660e2d6c5cde tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "POST /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.339509 Jun 06 13:09:08.502636 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 50/110] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:09:05 2022] POST /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019/os-volume_attachments => generated 194 bytes in 3343 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:09:08.536199 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b89cb7e2-e8a7-4447-b543-b1f7a74ee542 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:08.537679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b89cb7e2-e8a7-4447-b543-b1f7a74ee542 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:08.550927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b89cb7e2-e8a7-4447-b543-b1f7a74ee542 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:08.552828 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b89cb7e2-e8a7-4447-b543-b1f7a74ee542 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:08.555996 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b89cb7e2-e8a7-4447-b543-b1f7a74ee542 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:08.556463 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b89cb7e2-e8a7-4447-b543-b1f7a74ee542 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:08.720938 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-8c4e52ec-894b-47d7-bbf7-760b277fef65 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:08.722144 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8c4e52ec-894b-47d7-bbf7-760b277fef65 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:08.750611 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8c4e52ec-894b-47d7-bbf7-760b277fef65 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:08.751342 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8c4e52ec-894b-47d7-bbf7-760b277fef65 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:08.752832 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8c4e52ec-894b-47d7-bbf7-760b277fef65 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:08.753273 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8c4e52ec-894b-47d7-bbf7-760b277fef65 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:08.982338 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b89cb7e2-e8a7-4447-b543-b1f7a74ee542 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:08.995862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b89cb7e2-e8a7-4447-b543-b1f7a74ee542 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.464654 Jun 06 13:09:08.996680 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 61/111] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:08 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 467 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:09.001420 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-83079185-52b3-480e-adc9-dd028302b1aa req-4ac93c6b-1310-4f92-8b96-5a25cc6e5b0e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52d4675-f6b5-4381-a005-d9ba7c7c4b90", "name": "network-vif-plugged", "status": "completed", "tag": "5d6dcaaf-ad13-4769-b8b2-14bbc7134365"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:09:09.005102 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:09.013299 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-83079185-52b3-480e-adc9-dd028302b1aa req-4ac93c6b-1310-4f92-8b96-5a25cc6e5b0e service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:09.014060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-83079185-52b3-480e-adc9-dd028302b1aa req-4ac93c6b-1310-4f92-8b96-5a25cc6e5b0e service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:09.029925 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-83079185-52b3-480e-adc9-dd028302b1aa req-4ac93c6b-1310-4f92-8b96-5a25cc6e5b0e service nova] Creating event network-vif-plugged:5d6dcaaf-ad13-4769-b8b2-14bbc7134365 for instance a52d4675-f6b5-4381-a005-d9ba7c7c4b90 on hv-cinder-75510 Jun 06 13:09:09.035616 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-83079185-52b3-480e-adc9-dd028302b1aa req-4ac93c6b-1310-4f92-8b96-5a25cc6e5b0e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037390 Jun 06 13:09:09.036692 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 62/112] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:09:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:09:09.043338 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-484eb69d-aa5b-49e5-8519-6e4fc8018fdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:09.044632 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-484eb69d-aa5b-49e5-8519-6e4fc8018fdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:09.050941 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-8c4e52ec-894b-47d7-bbf7-760b277fef65 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:09.065445 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-484eb69d-aa5b-49e5-8519-6e4fc8018fdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:09.066254 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-484eb69d-aa5b-49e5-8519-6e4fc8018fdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:09.067307 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-484eb69d-aa5b-49e5-8519-6e4fc8018fdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:09.068222 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-484eb69d-aa5b-49e5-8519-6e4fc8018fdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:09.077666 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-8c4e52ec-894b-47d7-bbf7-760b277fef65 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.362255 Jun 06 13:09:09.078983 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 51/113] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:08 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:09.195757 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5f9f6e8f-8982-431a-a0e0-736d04ecd1b9 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:09.195757 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5f9f6e8f-8982-431a-a0e0-736d04ecd1b9 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:09.201018 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5f9f6e8f-8982-431a-a0e0-736d04ecd1b9 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:09.201688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5f9f6e8f-8982-431a-a0e0-736d04ecd1b9 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:09.202705 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5f9f6e8f-8982-431a-a0e0-736d04ecd1b9 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:09.203345 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5f9f6e8f-8982-431a-a0e0-736d04ecd1b9 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:09.370229 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-484eb69d-aa5b-49e5-8519-6e4fc8018fdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:09.377546 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:09.397548 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-484eb69d-aa5b-49e5-8519-6e4fc8018fdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:09.401941 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-484eb69d-aa5b-49e5-8519-6e4fc8018fdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:09.403501 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5f9f6e8f-8982-431a-a0e0-736d04ecd1b9 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:09.404008 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-484eb69d-aa5b-49e5-8519-6e4fc8018fdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.365620 Jun 06 13:09:09.411780 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5f9f6e8f-8982-431a-a0e0-736d04ecd1b9 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1322 microversion: 2.1 time: 0.222900 Jun 06 13:09:09.412634 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 52/114] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:09 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1322 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:09.416674 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 63/115] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:09 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:10.015456 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5be3e221-4737-49c4-9a4f-a5522acba09e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:10.020328 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5be3e221-4737-49c4-9a4f-a5522acba09e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:10.024716 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5be3e221-4737-49c4-9a4f-a5522acba09e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:10.025414 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5be3e221-4737-49c4-9a4f-a5522acba09e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:10.026495 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5be3e221-4737-49c4-9a4f-a5522acba09e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:10.028012 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5be3e221-4737-49c4-9a4f-a5522acba09e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:10.096369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-164cabb8-d05c-4ddc-a38a-caca5e63d4b0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:10.098079 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-164cabb8-d05c-4ddc-a38a-caca5e63d4b0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:10.116274 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-164cabb8-d05c-4ddc-a38a-caca5e63d4b0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:10.117021 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-164cabb8-d05c-4ddc-a38a-caca5e63d4b0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:10.118168 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-164cabb8-d05c-4ddc-a38a-caca5e63d4b0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:10.118766 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-164cabb8-d05c-4ddc-a38a-caca5e63d4b0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:10.226239 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5be3e221-4737-49c4-9a4f-a5522acba09e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:10.236208 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5be3e221-4737-49c4-9a4f-a5522acba09e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.225638 Jun 06 13:09:10.246146 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 53/116] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:10 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:10.310131 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-164cabb8-d05c-4ddc-a38a-caca5e63d4b0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:10.319627 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-164cabb8-d05c-4ddc-a38a-caca5e63d4b0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.228923 Jun 06 13:09:10.330318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 64/117] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:10 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:10.424726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a00e9ee0-6130-458e-bdeb-10ff2686d5f8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:10.425459 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a00e9ee0-6130-458e-bdeb-10ff2686d5f8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:10.428384 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-71a21758-4b5d-4d3c-9f4f-736bc28d657a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:10.429180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-71a21758-4b5d-4d3c-9f4f-736bc28d657a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:10.434379 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a00e9ee0-6130-458e-bdeb-10ff2686d5f8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:10.434978 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a00e9ee0-6130-458e-bdeb-10ff2686d5f8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:10.435901 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a00e9ee0-6130-458e-bdeb-10ff2686d5f8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:10.436586 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a00e9ee0-6130-458e-bdeb-10ff2686d5f8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:10.439029 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-71a21758-4b5d-4d3c-9f4f-736bc28d657a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:10.439731 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-71a21758-4b5d-4d3c-9f4f-736bc28d657a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:10.440674 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-71a21758-4b5d-4d3c-9f4f-736bc28d657a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:10.445102 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-71a21758-4b5d-4d3c-9f4f-736bc28d657a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:10.664949 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-71a21758-4b5d-4d3c-9f4f-736bc28d657a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:10.673549 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-71a21758-4b5d-4d3c-9f4f-736bc28d657a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1322 microversion: 2.1 time: 0.248895 Jun 06 13:09:10.674678 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 65/118] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:10 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1322 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:10.687564 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a00e9ee0-6130-458e-bdeb-10ff2686d5f8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:10.699269 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a00e9ee0-6130-458e-bdeb-10ff2686d5f8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:10.702027 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a00e9ee0-6130-458e-bdeb-10ff2686d5f8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:10.703173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a00e9ee0-6130-458e-bdeb-10ff2686d5f8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.284366 Jun 06 13:09:10.703758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 54/119] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:10 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:11.093820 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-db01719c-6eb5-4bed-8f70-124220b11d19 req-3e1651a2-0fe0-4ac0-b3eb-b631aa61d0de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c50c488-a0ae-4331-9dfe-5fb0b7ab5108", "name": "network-vif-plugged", "status": "completed", "tag": "2afcefdf-f52a-4b50-9bf5-21e35aed0ff2"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:09:11.101868 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-db01719c-6eb5-4bed-8f70-124220b11d19 req-3e1651a2-0fe0-4ac0-b3eb-b631aa61d0de service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:11.102572 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-db01719c-6eb5-4bed-8f70-124220b11d19 req-3e1651a2-0fe0-4ac0-b3eb-b631aa61d0de service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:11.114242 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-db01719c-6eb5-4bed-8f70-124220b11d19 req-3e1651a2-0fe0-4ac0-b3eb-b631aa61d0de service nova] Creating event network-vif-plugged:2afcefdf-f52a-4b50-9bf5-21e35aed0ff2 for instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 on hv-cinder-75510 Jun 06 13:09:11.120665 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-db01719c-6eb5-4bed-8f70-124220b11d19 req-3e1651a2-0fe0-4ac0-b3eb-b631aa61d0de service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029773 Jun 06 13:09:11.121552 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 66/120] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:09:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:09:11.254251 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-96b5473c-b11d-4aaa-a4aa-79d9e9064a72 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:11.254866 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-96b5473c-b11d-4aaa-a4aa-79d9e9064a72 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:11.261915 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-96b5473c-b11d-4aaa-a4aa-79d9e9064a72 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:11.262366 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-96b5473c-b11d-4aaa-a4aa-79d9e9064a72 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:11.263341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-96b5473c-b11d-4aaa-a4aa-79d9e9064a72 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:11.264450 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-96b5473c-b11d-4aaa-a4aa-79d9e9064a72 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:11.342103 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-099ab0c9-26fd-4c79-b753-a2c9bb1dce9d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:11.344052 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-099ab0c9-26fd-4c79-b753-a2c9bb1dce9d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:11.360158 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-099ab0c9-26fd-4c79-b753-a2c9bb1dce9d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:11.360678 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-099ab0c9-26fd-4c79-b753-a2c9bb1dce9d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:11.361452 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-099ab0c9-26fd-4c79-b753-a2c9bb1dce9d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:11.361877 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-099ab0c9-26fd-4c79-b753-a2c9bb1dce9d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:11.420966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-96b5473c-b11d-4aaa-a4aa-79d9e9064a72 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:11.429261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-96b5473c-b11d-4aaa-a4aa-79d9e9064a72 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.178802 Jun 06 13:09:11.429948 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 55/121] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:11 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:11.521608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-099ab0c9-26fd-4c79-b753-a2c9bb1dce9d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:11.530026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-099ab0c9-26fd-4c79-b753-a2c9bb1dce9d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.195673 Jun 06 13:09:11.535504 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 67/122] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:11 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:11.691100 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cc564960-440c-4bf0-a83d-7579e34c1cac tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:11.691778 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-cc564960-440c-4bf0-a83d-7579e34c1cac tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:11.697739 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cc564960-440c-4bf0-a83d-7579e34c1cac tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:11.698187 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cc564960-440c-4bf0-a83d-7579e34c1cac tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:11.698960 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cc564960-440c-4bf0-a83d-7579e34c1cac tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:11.699401 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cc564960-440c-4bf0-a83d-7579e34c1cac tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:11.721308 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f7fd145f-9a6d-4697-8443-14ea571f2e01 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:11.721918 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f7fd145f-9a6d-4697-8443-14ea571f2e01 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:11.728739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f7fd145f-9a6d-4697-8443-14ea571f2e01 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:11.729812 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f7fd145f-9a6d-4697-8443-14ea571f2e01 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:11.730643 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f7fd145f-9a6d-4697-8443-14ea571f2e01 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:11.731135 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f7fd145f-9a6d-4697-8443-14ea571f2e01 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:11.909948 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cc564960-440c-4bf0-a83d-7579e34c1cac tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:11.919606 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cc564960-440c-4bf0-a83d-7579e34c1cac tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1517 microversion: 2.1 time: 0.232291 Jun 06 13:09:11.920462 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 56/123] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:11 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1517 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:11.925342 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f7fd145f-9a6d-4697-8443-14ea571f2e01 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:11.937271 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-66dc7c70-10e4-4e97-9349-4d50a981cb75 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:09:11.938477 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f7fd145f-9a6d-4697-8443-14ea571f2e01 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:11.938626 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-66dc7c70-10e4-4e97-9349-4d50a981cb75 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:11.940344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f7fd145f-9a6d-4697-8443-14ea571f2e01 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:11.941624 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f7fd145f-9a6d-4697-8443-14ea571f2e01 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.224496 Jun 06 13:09:11.942647 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 68/124] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:11 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:09:11.945396 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-66dc7c70-10e4-4e97-9349-4d50a981cb75 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:11.946221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-66dc7c70-10e4-4e97-9349-4d50a981cb75 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:11.947146 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-66dc7c70-10e4-4e97-9349-4d50a981cb75 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:11.948424 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-66dc7c70-10e4-4e97-9349-4d50a981cb75 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:11.974903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-66dc7c70-10e4-4e97-9349-4d50a981cb75 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lazy-loading 'flavor' on Instance uuid a52d4675-f6b5-4381-a005-d9ba7c7c4b90 {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:09:12.314917 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-66dc7c70-10e4-4e97-9349-4d50a981cb75 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "POST /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90/action" status: 200 len: 32 microversion: 2.1 time: 0.381775 Jun 06 13:09:12.315615 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 57/125] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:09:11 2022] POST /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90/action => generated 32 bytes in 383 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 13:09:12.326004 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8d835b94-a243-4dd9-bdbe-c627ec17c58d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:12.326681 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8d835b94-a243-4dd9-bdbe-c627ec17c58d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:12.333225 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8d835b94-a243-4dd9-bdbe-c627ec17c58d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:12.333668 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8d835b94-a243-4dd9-bdbe-c627ec17c58d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:12.334444 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8d835b94-a243-4dd9-bdbe-c627ec17c58d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:12.334887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8d835b94-a243-4dd9-bdbe-c627ec17c58d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:12.447417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-650f0b77-516c-4bed-baf9-cf40a365e4dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:12.448457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-650f0b77-516c-4bed-baf9-cf40a365e4dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:12.461646 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-650f0b77-516c-4bed-baf9-cf40a365e4dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:12.462102 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-650f0b77-516c-4bed-baf9-cf40a365e4dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:12.462895 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-650f0b77-516c-4bed-baf9-cf40a365e4dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:12.463387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-650f0b77-516c-4bed-baf9-cf40a365e4dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:12.569872 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8d835b94-a243-4dd9-bdbe-c627ec17c58d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:12.580744 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8d835b94-a243-4dd9-bdbe-c627ec17c58d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.259757 Jun 06 13:09:12.582730 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 69/126] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:12 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:12.596457 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2e7d0c74-0689-4f5e-916b-cfde6e7ce922 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:12.596457 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2e7d0c74-0689-4f5e-916b-cfde6e7ce922 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:12.611177 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2e7d0c74-0689-4f5e-916b-cfde6e7ce922 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:12.612863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2e7d0c74-0689-4f5e-916b-cfde6e7ce922 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:12.613890 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2e7d0c74-0689-4f5e-916b-cfde6e7ce922 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:12.617184 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2e7d0c74-0689-4f5e-916b-cfde6e7ce922 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:12.694632 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-650f0b77-516c-4bed-baf9-cf40a365e4dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:12.707817 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-650f0b77-516c-4bed-baf9-cf40a365e4dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.264517 Jun 06 13:09:12.722045 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 58/127] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:12 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:12.846840 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2e7d0c74-0689-4f5e-916b-cfde6e7ce922 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:12.855715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2e7d0c74-0689-4f5e-916b-cfde6e7ce922 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.271949 Jun 06 13:09:12.856467 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 70/128] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:12 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:12.960550 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ce455e5d-c29e-4c09-899c-cd3bcde67139 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:12.961158 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ce455e5d-c29e-4c09-899c-cd3bcde67139 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:12.968766 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ce455e5d-c29e-4c09-899c-cd3bcde67139 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:12.969238 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ce455e5d-c29e-4c09-899c-cd3bcde67139 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:12.970037 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ce455e5d-c29e-4c09-899c-cd3bcde67139 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:12.970475 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ce455e5d-c29e-4c09-899c-cd3bcde67139 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:13.117825 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ce455e5d-c29e-4c09-899c-cd3bcde67139 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:13.127880 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ce455e5d-c29e-4c09-899c-cd3bcde67139 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:13.140082 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ce455e5d-c29e-4c09-899c-cd3bcde67139 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:13.141143 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-da31b7b5-e2ee-433e-998e-fb9f2f0f8358 req-e4870025-cf48-4880-8725-14d79a92409f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec960d68-c9a5-4886-a3f3-07c63abf3cce", "name": "network-vif-plugged", "status": "completed", "tag": "cbf0dd9f-4c61-43db-b99d-07520fba79b9"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:09:13.141250 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ce455e5d-c29e-4c09-899c-cd3bcde67139 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.179571 Jun 06 13:09:13.147556 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 59/129] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:12 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:13.149285 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-da31b7b5-e2ee-433e-998e-fb9f2f0f8358 req-e4870025-cf48-4880-8725-14d79a92409f service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:13.149741 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-da31b7b5-e2ee-433e-998e-fb9f2f0f8358 req-e4870025-cf48-4880-8725-14d79a92409f service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:13.167238 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-da31b7b5-e2ee-433e-998e-fb9f2f0f8358 req-e4870025-cf48-4880-8725-14d79a92409f service nova] Creating event network-vif-plugged:cbf0dd9f-4c61-43db-b99d-07520fba79b9 for instance ec960d68-c9a5-4886-a3f3-07c63abf3cce on hv-cinder-75510 Jun 06 13:09:13.171593 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-da31b7b5-e2ee-433e-998e-fb9f2f0f8358 req-e4870025-cf48-4880-8725-14d79a92409f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039496 Jun 06 13:09:13.172285 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 71/130] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:09:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:09:13.600747 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9e9f1a8c-98a4-4985-bebf-8371ce02a56c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:13.601397 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9e9f1a8c-98a4-4985-bebf-8371ce02a56c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:13.609015 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9e9f1a8c-98a4-4985-bebf-8371ce02a56c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:13.609459 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9e9f1a8c-98a4-4985-bebf-8371ce02a56c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:13.610263 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9e9f1a8c-98a4-4985-bebf-8371ce02a56c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:13.610699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9e9f1a8c-98a4-4985-bebf-8371ce02a56c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:13.729602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-caddded8-1f92-4159-a26a-3e38925ddff6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:13.732947 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-caddded8-1f92-4159-a26a-3e38925ddff6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:13.740089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-caddded8-1f92-4159-a26a-3e38925ddff6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:13.740863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-caddded8-1f92-4159-a26a-3e38925ddff6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:13.741632 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-caddded8-1f92-4159-a26a-3e38925ddff6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:13.742062 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-caddded8-1f92-4159-a26a-3e38925ddff6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:13.773706 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9e9f1a8c-98a4-4985-bebf-8371ce02a56c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:13.781907 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9e9f1a8c-98a4-4985-bebf-8371ce02a56c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.185057 Jun 06 13:09:13.782928 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 60/131] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:13 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:13.878309 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-caddded8-1f92-4159-a26a-3e38925ddff6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:13.879753 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c582c447-3c51-4251-8100-192ecff4e795 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:13.880368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c582c447-3c51-4251-8100-192ecff4e795 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:13.887343 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c582c447-3c51-4251-8100-192ecff4e795 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:13.887830 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c582c447-3c51-4251-8100-192ecff4e795 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:13.888025 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-caddded8-1f92-4159-a26a-3e38925ddff6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.163878 Jun 06 13:09:13.888632 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c582c447-3c51-4251-8100-192ecff4e795 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:13.889103 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 72/132] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:13 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:13.889520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c582c447-3c51-4251-8100-192ecff4e795 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:14.034291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c582c447-3c51-4251-8100-192ecff4e795 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:14.041770 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c582c447-3c51-4251-8100-192ecff4e795 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.166218 Jun 06 13:09:14.042340 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 61/133] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:13 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:14.154783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-feba65e9-d29f-40be-ae76-c1d4bff9554c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:14.155417 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-feba65e9-d29f-40be-ae76-c1d4bff9554c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:14.161578 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-feba65e9-d29f-40be-ae76-c1d4bff9554c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:14.162021 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-feba65e9-d29f-40be-ae76-c1d4bff9554c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:14.162775 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-feba65e9-d29f-40be-ae76-c1d4bff9554c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:14.163208 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-feba65e9-d29f-40be-ae76-c1d4bff9554c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:14.292526 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-feba65e9-d29f-40be-ae76-c1d4bff9554c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:14.300511 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-feba65e9-d29f-40be-ae76-c1d4bff9554c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:14.301997 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-feba65e9-d29f-40be-ae76-c1d4bff9554c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:14.303091 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-feba65e9-d29f-40be-ae76-c1d4bff9554c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.152973 Jun 06 13:09:14.303672 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 73/134] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:14 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:14.799520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-edf62e90-134a-4f6c-8fd6-6adc2f6d6e61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:14.800161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-edf62e90-134a-4f6c-8fd6-6adc2f6d6e61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:14.806773 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-edf62e90-134a-4f6c-8fd6-6adc2f6d6e61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:14.807391 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-edf62e90-134a-4f6c-8fd6-6adc2f6d6e61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:14.808458 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-edf62e90-134a-4f6c-8fd6-6adc2f6d6e61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:14.808901 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-edf62e90-134a-4f6c-8fd6-6adc2f6d6e61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:14.907770 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dc02980d-2302-4449-bd4d-73425c395c53 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:14.908973 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dc02980d-2302-4449-bd4d-73425c395c53 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:14.916375 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc02980d-2302-4449-bd4d-73425c395c53 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:14.918263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc02980d-2302-4449-bd4d-73425c395c53 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:14.919351 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc02980d-2302-4449-bd4d-73425c395c53 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:14.919983 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc02980d-2302-4449-bd4d-73425c395c53 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:14.949313 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-edf62e90-134a-4f6c-8fd6-6adc2f6d6e61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:14.956929 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-edf62e90-134a-4f6c-8fd6-6adc2f6d6e61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.161320 Jun 06 13:09:14.957507 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 62/135] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:14 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:15.054730 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dc02980d-2302-4449-bd4d-73425c395c53 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:15.059542 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-57d6dd57-7672-4d52-aaa2-d2c3affa41a9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:15.060160 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-57d6dd57-7672-4d52-aaa2-d2c3affa41a9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:15.062994 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dc02980d-2302-4449-bd4d-73425c395c53 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.160650 Jun 06 13:09:15.063577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 74/136] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:14 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:15.066346 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-57d6dd57-7672-4d52-aaa2-d2c3affa41a9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:15.066795 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-57d6dd57-7672-4d52-aaa2-d2c3affa41a9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:15.067596 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-57d6dd57-7672-4d52-aaa2-d2c3affa41a9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:15.068090 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-57d6dd57-7672-4d52-aaa2-d2c3affa41a9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:15.189001 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-09da077a-2de8-41e0-a0d1-c9f378dec0ad req-dfd532a4-5308-44a3-9998-671fbef381ec service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc5ce11-0a01-44fd-9be7-c095a8254551", "name": "network-vif-plugged", "status": "completed", "tag": "5fd26d76-0c93-4177-8c73-21f7779282ef"}, {"server_uuid": "05c0144f-361b-4c15-813d-6c7b190ff600", "name": "network-vif-plugged", "status": "completed", "tag": "39a2bbdc-cbb4-47cf-8e60-ceacd2a33a82"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:09:15.199148 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-09da077a-2de8-41e0-a0d1-c9f378dec0ad req-dfd532a4-5308-44a3-9998-671fbef381ec service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:15.201780 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-09da077a-2de8-41e0-a0d1-c9f378dec0ad req-dfd532a4-5308-44a3-9998-671fbef381ec service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:15.211963 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-57d6dd57-7672-4d52-aaa2-d2c3affa41a9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:15.214761 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:15.216378 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-09da077a-2de8-41e0-a0d1-c9f378dec0ad req-dfd532a4-5308-44a3-9998-671fbef381ec service nova] Creating event network-vif-plugged:5fd26d76-0c93-4177-8c73-21f7779282ef for instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 on hv-cinder-75510 Jun 06 13:09:15.216981 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-09da077a-2de8-41e0-a0d1-c9f378dec0ad req-dfd532a4-5308-44a3-9998-671fbef381ec service nova] Creating event network-vif-plugged:39a2bbdc-cbb4-47cf-8e60-ceacd2a33a82 for instance 05c0144f-361b-4c15-813d-6c7b190ff600 on hv-cinder-75510 Jun 06 13:09:15.220769 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-57d6dd57-7672-4d52-aaa2-d2c3affa41a9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.166390 Jun 06 13:09:15.221633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 63/137] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:15 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:15.223325 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-09da077a-2de8-41e0-a0d1-c9f378dec0ad req-dfd532a4-5308-44a3-9998-671fbef381ec service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.038342 Jun 06 13:09:15.226336 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 75/138] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:09:15 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:09:15.321470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-839942bf-2fad-4fb1-b432-50b98adcbe2c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:15.322081 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-839942bf-2fad-4fb1-b432-50b98adcbe2c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:15.329412 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-839942bf-2fad-4fb1-b432-50b98adcbe2c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:15.329856 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-839942bf-2fad-4fb1-b432-50b98adcbe2c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:15.330630 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-839942bf-2fad-4fb1-b432-50b98adcbe2c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:15.331058 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-839942bf-2fad-4fb1-b432-50b98adcbe2c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:15.468367 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-839942bf-2fad-4fb1-b432-50b98adcbe2c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:15.476179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-839942bf-2fad-4fb1-b432-50b98adcbe2c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:15.477800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-839942bf-2fad-4fb1-b432-50b98adcbe2c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:15.479487 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-839942bf-2fad-4fb1-b432-50b98adcbe2c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.161366 Jun 06 13:09:15.480120 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 64/139] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:15 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:15.975301 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d872fd21-a469-41e6-956d-d73c51a29ad6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:15.976001 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d872fd21-a469-41e6-956d-d73c51a29ad6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:15.984010 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d872fd21-a469-41e6-956d-d73c51a29ad6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:15.984520 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d872fd21-a469-41e6-956d-d73c51a29ad6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:15.985271 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d872fd21-a469-41e6-956d-d73c51a29ad6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:15.985697 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d872fd21-a469-41e6-956d-d73c51a29ad6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:16.080818 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ab7c275e-5dac-41f4-9d83-dbe178544dac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:16.082574 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ab7c275e-5dac-41f4-9d83-dbe178544dac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:16.090188 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ab7c275e-5dac-41f4-9d83-dbe178544dac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:16.090714 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ab7c275e-5dac-41f4-9d83-dbe178544dac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:16.091656 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ab7c275e-5dac-41f4-9d83-dbe178544dac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:16.092088 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ab7c275e-5dac-41f4-9d83-dbe178544dac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:16.130574 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d872fd21-a469-41e6-956d-d73c51a29ad6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:16.138923 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d872fd21-a469-41e6-956d-d73c51a29ad6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.167823 Jun 06 13:09:16.139499 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 76/140] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:15 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:16.228699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ab7c275e-5dac-41f4-9d83-dbe178544dac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:16.236484 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ab7c275e-5dac-41f4-9d83-dbe178544dac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.160223 Jun 06 13:09:16.237059 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 65/141] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:16 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:16.244717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8c1965dd-109b-4e9f-8673-0f3dca11bcea tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:16.244717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8c1965dd-109b-4e9f-8673-0f3dca11bcea tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:16.251109 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c1965dd-109b-4e9f-8673-0f3dca11bcea tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:16.251591 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c1965dd-109b-4e9f-8673-0f3dca11bcea tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:16.252374 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c1965dd-109b-4e9f-8673-0f3dca11bcea tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:16.252808 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c1965dd-109b-4e9f-8673-0f3dca11bcea tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:16.388742 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8c1965dd-109b-4e9f-8673-0f3dca11bcea tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:16.396463 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8c1965dd-109b-4e9f-8673-0f3dca11bcea tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.158617 Jun 06 13:09:16.397032 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 77/142] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:16 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:16.499081 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6f6bc8f9-a52e-45a8-bb50-1a25657964f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:16.499652 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6f6bc8f9-a52e-45a8-bb50-1a25657964f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:16.506479 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6f6bc8f9-a52e-45a8-bb50-1a25657964f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:16.507112 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6f6bc8f9-a52e-45a8-bb50-1a25657964f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:16.507908 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6f6bc8f9-a52e-45a8-bb50-1a25657964f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:16.508340 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6f6bc8f9-a52e-45a8-bb50-1a25657964f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:16.668854 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6f6bc8f9-a52e-45a8-bb50-1a25657964f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:16.678414 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6f6bc8f9-a52e-45a8-bb50-1a25657964f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:16.680420 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6f6bc8f9-a52e-45a8-bb50-1a25657964f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:16.689897 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6f6bc8f9-a52e-45a8-bb50-1a25657964f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.195495 Jun 06 13:09:16.690476 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 66/143] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:16 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:17.156427 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-08d542fa-f1d4-4ffe-b51e-ed0388c9d709 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:17.157019 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-08d542fa-f1d4-4ffe-b51e-ed0388c9d709 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:17.163006 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-08d542fa-f1d4-4ffe-b51e-ed0388c9d709 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:17.163442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-08d542fa-f1d4-4ffe-b51e-ed0388c9d709 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:17.164219 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-08d542fa-f1d4-4ffe-b51e-ed0388c9d709 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:17.164640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-08d542fa-f1d4-4ffe-b51e-ed0388c9d709 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:17.259360 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-eeda7b6c-070c-4865-81e5-cb7b9d8215c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:17.260820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-eeda7b6c-070c-4865-81e5-cb7b9d8215c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:17.263304 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=6 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:17.269144 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-eeda7b6c-070c-4865-81e5-cb7b9d8215c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:17.271652 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-eeda7b6c-070c-4865-81e5-cb7b9d8215c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:17.271652 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-eeda7b6c-070c-4865-81e5-cb7b9d8215c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:17.271652 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-eeda7b6c-070c-4865-81e5-cb7b9d8215c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:17.330725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-08d542fa-f1d4-4ffe-b51e-ed0388c9d709 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:17.338500 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-08d542fa-f1d4-4ffe-b51e-ed0388c9d709 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.185678 Jun 06 13:09:17.339076 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 78/144] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:17 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:17.413636 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a82f0489-2387-46f5-a0d5-e1e08b674d43 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:17.414245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a82f0489-2387-46f5-a0d5-e1e08b674d43 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:17.419635 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-eeda7b6c-070c-4865-81e5-cb7b9d8215c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:17.420626 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a82f0489-2387-46f5-a0d5-e1e08b674d43 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:17.421245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a82f0489-2387-46f5-a0d5-e1e08b674d43 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:17.422182 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a82f0489-2387-46f5-a0d5-e1e08b674d43 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:17.422774 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a82f0489-2387-46f5-a0d5-e1e08b674d43 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:17.427914 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-eeda7b6c-070c-4865-81e5-cb7b9d8215c4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.172576 Jun 06 13:09:17.428688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 67/145] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:17 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:17.559385 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a82f0489-2387-46f5-a0d5-e1e08b674d43 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:17.566884 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a82f0489-2387-46f5-a0d5-e1e08b674d43 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.157123 Jun 06 13:09:17.567455 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 79/146] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:17 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:17.707917 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c7de5f80-797b-4d42-b17e-495e20136482 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:17.708521 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c7de5f80-797b-4d42-b17e-495e20136482 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:17.714581 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c7de5f80-797b-4d42-b17e-495e20136482 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:17.715027 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c7de5f80-797b-4d42-b17e-495e20136482 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:17.715820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c7de5f80-797b-4d42-b17e-495e20136482 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:17.716252 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c7de5f80-797b-4d42-b17e-495e20136482 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:17.848144 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c7de5f80-797b-4d42-b17e-495e20136482 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:17.855293 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c7de5f80-797b-4d42-b17e-495e20136482 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:17.856836 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c7de5f80-797b-4d42-b17e-495e20136482 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:17.857948 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c7de5f80-797b-4d42-b17e-495e20136482 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.153846 Jun 06 13:09:17.858669 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 68/147] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:17 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:18.355955 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4a9aaaaa-263f-46fe-9c64-cfb17843b96d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:18.356635 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4a9aaaaa-263f-46fe-9c64-cfb17843b96d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:18.362845 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4a9aaaaa-263f-46fe-9c64-cfb17843b96d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:18.363287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4a9aaaaa-263f-46fe-9c64-cfb17843b96d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:18.364090 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4a9aaaaa-263f-46fe-9c64-cfb17843b96d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:18.364604 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4a9aaaaa-263f-46fe-9c64-cfb17843b96d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:18.449000 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a352346f-16e7-4c04-a4e2-337d07d6047d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:18.449623 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a352346f-16e7-4c04-a4e2-337d07d6047d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:18.456798 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a352346f-16e7-4c04-a4e2-337d07d6047d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:18.457568 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a352346f-16e7-4c04-a4e2-337d07d6047d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:18.458331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a352346f-16e7-4c04-a4e2-337d07d6047d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:18.458788 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a352346f-16e7-4c04-a4e2-337d07d6047d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:18.500817 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4a9aaaaa-263f-46fe-9c64-cfb17843b96d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:18.510306 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4a9aaaaa-263f-46fe-9c64-cfb17843b96d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.158299 Jun 06 13:09:18.511106 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 80/148] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:18 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:18.584388 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6844ccf6-c49b-457b-bbc5-510eefe8782d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:18.585126 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6844ccf6-c49b-457b-bbc5-510eefe8782d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:18.595712 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6844ccf6-c49b-457b-bbc5-510eefe8782d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:18.595712 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6844ccf6-c49b-457b-bbc5-510eefe8782d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:18.595712 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6844ccf6-c49b-457b-bbc5-510eefe8782d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:18.595712 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6844ccf6-c49b-457b-bbc5-510eefe8782d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:18.612232 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a352346f-16e7-4c04-a4e2-337d07d6047d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:18.621531 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a352346f-16e7-4c04-a4e2-337d07d6047d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.178638 Jun 06 13:09:18.622621 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 69/149] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:18 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:18.740049 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6844ccf6-c49b-457b-bbc5-510eefe8782d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:18.748416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6844ccf6-c49b-457b-bbc5-510eefe8782d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.167895 Jun 06 13:09:18.748991 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 81/150] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:18 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:18.877276 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-184ef508-4ab6-42d7-8316-b0dac4728b45 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:18.878175 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-184ef508-4ab6-42d7-8316-b0dac4728b45 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:18.887307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-184ef508-4ab6-42d7-8316-b0dac4728b45 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:18.888127 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-184ef508-4ab6-42d7-8316-b0dac4728b45 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:18.889022 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-184ef508-4ab6-42d7-8316-b0dac4728b45 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:18.889888 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-184ef508-4ab6-42d7-8316-b0dac4728b45 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:19.043696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-184ef508-4ab6-42d7-8316-b0dac4728b45 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:19.051464 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-184ef508-4ab6-42d7-8316-b0dac4728b45 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:19.052976 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-184ef508-4ab6-42d7-8316-b0dac4728b45 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:19.054058 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-184ef508-4ab6-42d7-8316-b0dac4728b45 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.181609 Jun 06 13:09:19.054614 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 70/151] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:18 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:19.532673 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8223c7fe-aa08-40a2-bee1-f06dc7832d63 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:19.533374 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8223c7fe-aa08-40a2-bee1-f06dc7832d63 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:19.539977 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8223c7fe-aa08-40a2-bee1-f06dc7832d63 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:19.540418 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8223c7fe-aa08-40a2-bee1-f06dc7832d63 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:19.541285 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8223c7fe-aa08-40a2-bee1-f06dc7832d63 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:19.541745 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8223c7fe-aa08-40a2-bee1-f06dc7832d63 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:19.567394 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:19.638903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-04b49b9f-91d8-471e-9a30-fcdb8c5f82ab tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:19.639904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-04b49b9f-91d8-471e-9a30-fcdb8c5f82ab tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:19.646770 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04b49b9f-91d8-471e-9a30-fcdb8c5f82ab tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:19.647213 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04b49b9f-91d8-471e-9a30-fcdb8c5f82ab tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:19.647999 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04b49b9f-91d8-471e-9a30-fcdb8c5f82ab tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:19.648431 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04b49b9f-91d8-471e-9a30-fcdb8c5f82ab tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:19.687567 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8223c7fe-aa08-40a2-bee1-f06dc7832d63 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:19.696697 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8223c7fe-aa08-40a2-bee1-f06dc7832d63 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.168045 Jun 06 13:09:19.698204 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 82/152] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:19 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:19.765634 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-128568f0-e72d-48db-9675-f423ada547c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:19.766251 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-128568f0-e72d-48db-9675-f423ada547c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:19.772268 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-128568f0-e72d-48db-9675-f423ada547c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:19.772714 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-128568f0-e72d-48db-9675-f423ada547c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:19.773487 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-128568f0-e72d-48db-9675-f423ada547c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:19.773926 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-128568f0-e72d-48db-9675-f423ada547c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:19.789205 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-04b49b9f-91d8-471e-9a30-fcdb8c5f82ab tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:19.802216 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-04b49b9f-91d8-471e-9a30-fcdb8c5f82ab tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.163789 Jun 06 13:09:19.802216 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 71/153] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:19 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:19.915397 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-128568f0-e72d-48db-9675-f423ada547c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:19.924692 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-128568f0-e72d-48db-9675-f423ada547c1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.163208 Jun 06 13:09:19.925485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 83/154] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:19 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:20.073204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5d117152-c9ef-43f7-b2cd-773f5795634b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:20.084118 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5d117152-c9ef-43f7-b2cd-773f5795634b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:20.084118 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5d117152-c9ef-43f7-b2cd-773f5795634b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:20.084118 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5d117152-c9ef-43f7-b2cd-773f5795634b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:20.084118 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5d117152-c9ef-43f7-b2cd-773f5795634b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:20.085573 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5d117152-c9ef-43f7-b2cd-773f5795634b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:20.214408 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5d117152-c9ef-43f7-b2cd-773f5795634b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:20.222942 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5d117152-c9ef-43f7-b2cd-773f5795634b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:20.224503 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5d117152-c9ef-43f7-b2cd-773f5795634b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:20.225603 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5d117152-c9ef-43f7-b2cd-773f5795634b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.156470 Jun 06 13:09:20.226158 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 72/155] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:20 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:20.714747 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ff6f8bad-017b-41df-adaa-9924b32f7551 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:20.715363 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ff6f8bad-017b-41df-adaa-9924b32f7551 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:20.741040 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ff6f8bad-017b-41df-adaa-9924b32f7551 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:20.741480 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ff6f8bad-017b-41df-adaa-9924b32f7551 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:20.745950 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ff6f8bad-017b-41df-adaa-9924b32f7551 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:20.746424 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ff6f8bad-017b-41df-adaa-9924b32f7551 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:20.818863 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bef8e6a7-4935-40eb-9584-13eaa8815539 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:20.819464 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-bef8e6a7-4935-40eb-9584-13eaa8815539 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:20.826758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bef8e6a7-4935-40eb-9584-13eaa8815539 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:20.829981 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bef8e6a7-4935-40eb-9584-13eaa8815539 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:20.829981 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bef8e6a7-4935-40eb-9584-13eaa8815539 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:20.829981 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bef8e6a7-4935-40eb-9584-13eaa8815539 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:20.965992 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ff6f8bad-017b-41df-adaa-9924b32f7551 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:20.973472 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ff6f8bad-017b-41df-adaa-9924b32f7551 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.263045 Jun 06 13:09:20.975962 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 84/156] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:20 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:20.978684 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4035db32-f9ad-495d-888f-3ab1bf5b19d6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:20.979276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4035db32-f9ad-495d-888f-3ab1bf5b19d6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:20.985376 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4035db32-f9ad-495d-888f-3ab1bf5b19d6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:20.985824 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4035db32-f9ad-495d-888f-3ab1bf5b19d6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:20.986622 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4035db32-f9ad-495d-888f-3ab1bf5b19d6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:20.987089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4035db32-f9ad-495d-888f-3ab1bf5b19d6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:21.003787 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-bef8e6a7-4935-40eb-9584-13eaa8815539 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:21.013672 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-bef8e6a7-4935-40eb-9584-13eaa8815539 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.199914 Jun 06 13:09:21.014736 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 73/157] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:20 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:21.144206 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4035db32-f9ad-495d-888f-3ab1bf5b19d6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:21.152650 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4035db32-f9ad-495d-888f-3ab1bf5b19d6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.177518 Jun 06 13:09:21.153233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 85/158] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:20 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:21.243253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-29d0c857-bff8-4ec6-a652-9ae68549eb9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:21.244504 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-29d0c857-bff8-4ec6-a652-9ae68549eb9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:21.250869 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-29d0c857-bff8-4ec6-a652-9ae68549eb9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:21.251377 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-29d0c857-bff8-4ec6-a652-9ae68549eb9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:21.252194 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-29d0c857-bff8-4ec6-a652-9ae68549eb9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:21.252746 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-29d0c857-bff8-4ec6-a652-9ae68549eb9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:21.388384 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-29d0c857-bff8-4ec6-a652-9ae68549eb9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:21.396884 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-29d0c857-bff8-4ec6-a652-9ae68549eb9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:21.398432 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-29d0c857-bff8-4ec6-a652-9ae68549eb9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:21.399545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-29d0c857-bff8-4ec6-a652-9ae68549eb9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.160149 Jun 06 13:09:21.413919 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 74/159] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:21 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:21.990482 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-17551ce0-26d9-41c2-8e19-f030e039baa2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:21.991471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-17551ce0-26d9-41c2-8e19-f030e039baa2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:21.998363 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-17551ce0-26d9-41c2-8e19-f030e039baa2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:21.998805 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-17551ce0-26d9-41c2-8e19-f030e039baa2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:21.999589 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-17551ce0-26d9-41c2-8e19-f030e039baa2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:22.000018 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-17551ce0-26d9-41c2-8e19-f030e039baa2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:22.032146 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-01a08531-54b7-4fcb-aa9a-cb949765f1cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:22.032725 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-01a08531-54b7-4fcb-aa9a-cb949765f1cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:22.039091 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-01a08531-54b7-4fcb-aa9a-cb949765f1cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:22.039572 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-01a08531-54b7-4fcb-aa9a-cb949765f1cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:22.040345 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-01a08531-54b7-4fcb-aa9a-cb949765f1cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:22.041392 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-01a08531-54b7-4fcb-aa9a-cb949765f1cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:22.400888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-17551ce0-26d9-41c2-8e19-f030e039baa2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:22.416638 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-17551ce0-26d9-41c2-8e19-f030e039baa2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.423197 Jun 06 13:09:22.416638 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 86/160] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:21 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:22.416638 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-62159fff-2262-42cc-b003-f6520566d9a5 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:22.416638 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-62159fff-2262-42cc-b003-f6520566d9a5 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:22.422254 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-62159fff-2262-42cc-b003-f6520566d9a5 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:22.422695 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-62159fff-2262-42cc-b003-f6520566d9a5 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:22.423459 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-62159fff-2262-42cc-b003-f6520566d9a5 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:22.423929 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-62159fff-2262-42cc-b003-f6520566d9a5 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:22.425756 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-01a08531-54b7-4fcb-aa9a-cb949765f1cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:22.434008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-01a08531-54b7-4fcb-aa9a-cb949765f1cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1367 microversion: 2.1 time: 0.405541 Jun 06 13:09:22.434880 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 75/161] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:22 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1367 bytes in 407 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:22.439570 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ef833d70-f63a-485a-b7eb-12e2ceba58e6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:22.440179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ef833d70-f63a-485a-b7eb-12e2ceba58e6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:22.446430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ef833d70-f63a-485a-b7eb-12e2ceba58e6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:22.449246 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ef833d70-f63a-485a-b7eb-12e2ceba58e6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:22.449246 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ef833d70-f63a-485a-b7eb-12e2ceba58e6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:22.449246 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ef833d70-f63a-485a-b7eb-12e2ceba58e6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:22.650814 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-62159fff-2262-42cc-b003-f6520566d9a5 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:22.657004 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-62159fff-2262-42cc-b003-f6520566d9a5 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.245573 Jun 06 13:09:22.667850 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 87/162] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:22 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:22.668941 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ef833d70-f63a-485a-b7eb-12e2ceba58e6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:22.677126 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ef833d70-f63a-485a-b7eb-12e2ceba58e6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:22.678666 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ef833d70-f63a-485a-b7eb-12e2ceba58e6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:22.688555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ef833d70-f63a-485a-b7eb-12e2ceba58e6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.243966 Jun 06 13:09:22.688555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 76/163] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:22 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:23.426156 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a7e9bf4b-a986-4ff5-9b16-669e2ffb2ff3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:23.426732 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a7e9bf4b-a986-4ff5-9b16-669e2ffb2ff3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:23.433494 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a7e9bf4b-a986-4ff5-9b16-669e2ffb2ff3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:23.433984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a7e9bf4b-a986-4ff5-9b16-669e2ffb2ff3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:23.434729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a7e9bf4b-a986-4ff5-9b16-669e2ffb2ff3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:23.435161 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a7e9bf4b-a986-4ff5-9b16-669e2ffb2ff3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:23.451812 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-acc04edc-8b14-4af4-bd94-ec241ace885c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:23.452393 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-acc04edc-8b14-4af4-bd94-ec241ace885c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:23.458872 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-acc04edc-8b14-4af4-bd94-ec241ace885c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:23.459545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-acc04edc-8b14-4af4-bd94-ec241ace885c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:23.460542 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-acc04edc-8b14-4af4-bd94-ec241ace885c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:23.460971 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-acc04edc-8b14-4af4-bd94-ec241ace885c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:23.638363 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a7e9bf4b-a986-4ff5-9b16-669e2ffb2ff3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:23.646789 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a7e9bf4b-a986-4ff5-9b16-669e2ffb2ff3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.224577 Jun 06 13:09:23.649027 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 88/164] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:23 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:23.653164 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-acc04edc-8b14-4af4-bd94-ec241ace885c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:23.661584 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-acc04edc-8b14-4af4-bd94-ec241ace885c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1558 microversion: 2.1 time: 0.214663 Jun 06 13:09:23.662349 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 77/165] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:23 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:23.677158 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d0004aac-3f98-4beb-a4ef-e47f051416e3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:23.677846 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d0004aac-3f98-4beb-a4ef-e47f051416e3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:23.678429 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6a4c0e69-d0d4-432e-a9c1-af6fe67780e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:23.678959 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6a4c0e69-d0d4-432e-a9c1-af6fe67780e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:23.684469 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0004aac-3f98-4beb-a4ef-e47f051416e3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:23.684919 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0004aac-3f98-4beb-a4ef-e47f051416e3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:23.685038 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6a4c0e69-d0d4-432e-a9c1-af6fe67780e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:23.685410 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6a4c0e69-d0d4-432e-a9c1-af6fe67780e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:23.685696 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0004aac-3f98-4beb-a4ef-e47f051416e3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:23.686186 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0004aac-3f98-4beb-a4ef-e47f051416e3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:23.686305 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6a4c0e69-d0d4-432e-a9c1-af6fe67780e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:23.686592 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6a4c0e69-d0d4-432e-a9c1-af6fe67780e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:23.809473 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6a4c0e69-d0d4-432e-a9c1-af6fe67780e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.134688 Jun 06 13:09:23.810155 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 78/166] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 13:09:23 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-interface => generated 285 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:09:23.815161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fe4c299b-566a-4097-a915-2c2fb6fb7450 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:23.815557 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-fe4c299b-566a-4097-a915-2c2fb6fb7450 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:23.826674 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe4c299b-566a-4097-a915-2c2fb6fb7450 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:23.833910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe4c299b-566a-4097-a915-2c2fb6fb7450 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:23.833910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe4c299b-566a-4097-a915-2c2fb6fb7450 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:23.833910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe4c299b-566a-4097-a915-2c2fb6fb7450 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:23.882336 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0004aac-3f98-4beb-a4ef-e47f051416e3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:23.891120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d0004aac-3f98-4beb-a4ef-e47f051416e3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1364 microversion: 2.1 time: 0.218149 Jun 06 13:09:23.891813 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 89/167] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:23 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1364 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:23.896508 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9678307e-c78e-4bca-850a-0d447fd1166b tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:23.897147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9678307e-c78e-4bca-850a-0d447fd1166b tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:23.904080 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9678307e-c78e-4bca-850a-0d447fd1166b tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:23.904941 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9678307e-c78e-4bca-850a-0d447fd1166b tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:23.905868 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9678307e-c78e-4bca-850a-0d447fd1166b tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:23.906549 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9678307e-c78e-4bca-850a-0d447fd1166b tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:23.946132 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9678307e-c78e-4bca-850a-0d447fd1166b tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:09:23.994552 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-fe4c299b-566a-4097-a915-2c2fb6fb7450 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:24.004148 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-fe4c299b-566a-4097-a915-2c2fb6fb7450 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:24.005919 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-fe4c299b-566a-4097-a915-2c2fb6fb7450 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:24.007414 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-fe4c299b-566a-4097-a915-2c2fb6fb7450 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1405 microversion: 2.20 time: 0.196255 Jun 06 13:09:24.008607 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 79/168] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:23 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1405 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:24.344189 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9678307e-c78e-4bca-850a-0d447fd1166b tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 204 len: 0 microversion: 2.1 time: 0.450919 Jun 06 13:09:24.344949 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 90/169] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:09:23 2022] DELETE /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 0 bytes in 452 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:09:24.353787 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9d35a41d-887c-4885-b453-308ba556ace2 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:24.354448 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9d35a41d-887c-4885-b453-308ba556ace2 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:24.360555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9d35a41d-887c-4885-b453-308ba556ace2 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:24.360998 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9d35a41d-887c-4885-b453-308ba556ace2 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:24.361810 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9d35a41d-887c-4885-b453-308ba556ace2 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:24.362365 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9d35a41d-887c-4885-b453-308ba556ace2 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:24.512023 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9d35a41d-887c-4885-b453-308ba556ace2 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:24.514795 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=100 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:24.521705 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9d35a41d-887c-4885-b453-308ba556ace2 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1554 microversion: 2.1 time: 0.172535 Jun 06 13:09:24.522503 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 80/170] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:24 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1554 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:24.669054 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-10a0de83-f7fc-4930-8a69-4afe1847ce0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:24.670332 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-10a0de83-f7fc-4930-8a69-4afe1847ce0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:24.677441 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-10a0de83-f7fc-4930-8a69-4afe1847ce0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:24.677893 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-10a0de83-f7fc-4930-8a69-4afe1847ce0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:24.678664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-10a0de83-f7fc-4930-8a69-4afe1847ce0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:24.679096 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-10a0de83-f7fc-4930-8a69-4afe1847ce0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:24.856956 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-10a0de83-f7fc-4930-8a69-4afe1847ce0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:24.865967 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-10a0de83-f7fc-4930-8a69-4afe1847ce0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.201349 Jun 06 13:09:24.866887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 91/171] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:24 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:24.912980 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fb9a70d2-53ad-4a90-a053-71343af38bdd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:24.914010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-fb9a70d2-53ad-4a90-a053-71343af38bdd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:24.922127 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fb9a70d2-53ad-4a90-a053-71343af38bdd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:24.922961 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fb9a70d2-53ad-4a90-a053-71343af38bdd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:24.925084 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fb9a70d2-53ad-4a90-a053-71343af38bdd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:24.926420 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fb9a70d2-53ad-4a90-a053-71343af38bdd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:25.027335 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9acc110e-1f69-4fec-be49-031c293358c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:25.028149 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9acc110e-1f69-4fec-be49-031c293358c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:25.035474 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9acc110e-1f69-4fec-be49-031c293358c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:25.039248 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9acc110e-1f69-4fec-be49-031c293358c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:25.039248 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9acc110e-1f69-4fec-be49-031c293358c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:25.039248 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9acc110e-1f69-4fec-be49-031c293358c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:25.072089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-fb9a70d2-53ad-4a90-a053-71343af38bdd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:25.080963 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-fb9a70d2-53ad-4a90-a053-71343af38bdd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1551 microversion: 2.1 time: 0.175383 Jun 06 13:09:25.085190 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 81/172] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:24 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1551 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:25.101868 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6675e8ed-e8a4-4479-a868-d9c272b488ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:25.102937 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6675e8ed-e8a4-4479-a868-d9c272b488ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:25.112121 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6675e8ed-e8a4-4479-a868-d9c272b488ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:25.113577 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6675e8ed-e8a4-4479-a868-d9c272b488ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:25.114717 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6675e8ed-e8a4-4479-a868-d9c272b488ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:25.116579 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6675e8ed-e8a4-4479-a868-d9c272b488ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:25.260906 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6675e8ed-e8a4-4479-a868-d9c272b488ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.164063 Jun 06 13:09:25.261719 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 82/173] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 13:09:25 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/os-interface => generated 285 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:09:25.283271 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9acc110e-1f69-4fec-be49-031c293358c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:25.297260 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9acc110e-1f69-4fec-be49-031c293358c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:25.315185 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9acc110e-1f69-4fec-be49-031c293358c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:25.318486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9acc110e-1f69-4fec-be49-031c293358c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1597 microversion: 2.20 time: 0.296121 Jun 06 13:09:25.324954 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 92/174] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:09:25 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1597 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:09:25.342664 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-87ea3249-26c0-42df-9d05-627ad6557869 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:25.343158 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-87ea3249-26c0-42df-9d05-627ad6557869 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:25.349379 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-87ea3249-26c0-42df-9d05-627ad6557869 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:25.349824 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-87ea3249-26c0-42df-9d05-627ad6557869 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:25.350591 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-87ea3249-26c0-42df-9d05-627ad6557869 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:25.351025 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-87ea3249-26c0-42df-9d05-627ad6557869 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:25.451246 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-87ea3249-26c0-42df-9d05-627ad6557869 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.112865 Jun 06 13:09:25.452889 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 83/175] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Jun 6 13:09:25 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-interface => generated 284 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 13:09:25.493402 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-c4ccba17-ef9a-40ac-8d7a-e55f2bb425dc req-0379a3fb-0c13-4b66-9840-4514aeeeba97 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ec960d68-c9a5-4886-a3f3-07c63abf3cce", "tag": "cbf0dd9f-4c61-43db-b99d-07520fba79b9"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:09:25.502663 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-c4ccba17-ef9a-40ac-8d7a-e55f2bb425dc req-0379a3fb-0c13-4b66-9840-4514aeeeba97 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:25.503241 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-c4ccba17-ef9a-40ac-8d7a-e55f2bb425dc req-0379a3fb-0c13-4b66-9840-4514aeeeba97 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:25.518488 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-c4ccba17-ef9a-40ac-8d7a-e55f2bb425dc req-0379a3fb-0c13-4b66-9840-4514aeeeba97 service nova] Creating event network-changed:cbf0dd9f-4c61-43db-b99d-07520fba79b9 for instance ec960d68-c9a5-4886-a3f3-07c63abf3cce on hv-cinder-75510 Jun 06 13:09:25.523800 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-c4ccba17-ef9a-40ac-8d7a-e55f2bb425dc req-0379a3fb-0c13-4b66-9840-4514aeeeba97 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035968 Jun 06 13:09:25.525705 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 93/176] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:09:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:09:25.542934 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a518a0ef-bce1-4ace-978f-648c917e6388 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:25.543751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a518a0ef-bce1-4ace-978f-648c917e6388 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:25.558282 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a518a0ef-bce1-4ace-978f-648c917e6388 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:25.558967 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a518a0ef-bce1-4ace-978f-648c917e6388 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:25.559936 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a518a0ef-bce1-4ace-978f-648c917e6388 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:25.560521 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a518a0ef-bce1-4ace-978f-648c917e6388 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:25.864756 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a518a0ef-bce1-4ace-978f-648c917e6388 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:25.882979 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d26898fd-5a13-452b-bd7e-c9acc6f3fb00 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:25.883835 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d26898fd-5a13-452b-bd7e-c9acc6f3fb00 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:25.890047 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a518a0ef-bce1-4ace-978f-648c917e6388 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1554 microversion: 2.1 time: 0.352869 Jun 06 13:09:25.891714 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 84/177] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:25 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1554 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:25.909664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d26898fd-5a13-452b-bd7e-c9acc6f3fb00 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:25.910077 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d26898fd-5a13-452b-bd7e-c9acc6f3fb00 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:25.910977 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d26898fd-5a13-452b-bd7e-c9acc6f3fb00 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:25.911922 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d26898fd-5a13-452b-bd7e-c9acc6f3fb00 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:26.284652 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d26898fd-5a13-452b-bd7e-c9acc6f3fb00 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:26.300413 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d26898fd-5a13-452b-bd7e-c9acc6f3fb00 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.420370 Jun 06 13:09:26.305497 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 94/178] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:25 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 428 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:26.911047 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4be6b7cf-1d4c-45b4-996b-cd05f4b8bf5a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:26.911708 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-4be6b7cf-1d4c-45b4-996b-cd05f4b8bf5a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:26.928006 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4be6b7cf-1d4c-45b4-996b-cd05f4b8bf5a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:26.928781 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4be6b7cf-1d4c-45b4-996b-cd05f4b8bf5a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:26.929924 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4be6b7cf-1d4c-45b4-996b-cd05f4b8bf5a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:26.932111 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4be6b7cf-1d4c-45b4-996b-cd05f4b8bf5a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:27.174677 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-4be6b7cf-1d4c-45b4-996b-cd05f4b8bf5a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:27.187301 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-4be6b7cf-1d4c-45b4-996b-cd05f4b8bf5a tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1554 microversion: 2.1 time: 0.280341 Jun 06 13:09:27.188781 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 85/179] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:26 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1554 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:27.321603 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6800a728-9b21-4d33-977d-07ea9d0f3b6f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:27.322407 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6800a728-9b21-4d33-977d-07ea9d0f3b6f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:27.338438 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6800a728-9b21-4d33-977d-07ea9d0f3b6f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:27.338884 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6800a728-9b21-4d33-977d-07ea9d0f3b6f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:27.344173 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6800a728-9b21-4d33-977d-07ea9d0f3b6f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:27.344173 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6800a728-9b21-4d33-977d-07ea9d0f3b6f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:27.383800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-00cae25b-dbc1-4535-a2f0-d21d614da560 req-c01c0e74-d90f-4d40-840f-06bd60a09f81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8fc5ce11-0a01-44fd-9be7-c095a8254551", "tag": "5fd26d76-0c93-4177-8c73-21f7779282ef"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:09:27.394008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-00cae25b-dbc1-4535-a2f0-d21d614da560 req-c01c0e74-d90f-4d40-840f-06bd60a09f81 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:27.394682 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-00cae25b-dbc1-4535-a2f0-d21d614da560 req-c01c0e74-d90f-4d40-840f-06bd60a09f81 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:27.410993 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-00cae25b-dbc1-4535-a2f0-d21d614da560 req-c01c0e74-d90f-4d40-840f-06bd60a09f81 service nova] Creating event network-changed:5fd26d76-0c93-4177-8c73-21f7779282ef for instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 on hv-cinder-75510 Jun 06 13:09:27.417793 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-00cae25b-dbc1-4535-a2f0-d21d614da560 req-c01c0e74-d90f-4d40-840f-06bd60a09f81 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.038008 Jun 06 13:09:27.418980 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 86/180] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:09:27.529172 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6800a728-9b21-4d33-977d-07ea9d0f3b6f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:27.537368 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6800a728-9b21-4d33-977d-07ea9d0f3b6f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.219793 Jun 06 13:09:27.537890 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 95/181] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:27 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:27.560806 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-a1f7115b-ccd1-4764-ad31-ac3724846ba9 req-26c356de-5022-4d3b-b39f-6f9fb2982223 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "05c0144f-361b-4c15-813d-6c7b190ff600", "tag": "39a2bbdc-cbb4-47cf-8e60-ceacd2a33a82"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:09:27.567910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-a1f7115b-ccd1-4764-ad31-ac3724846ba9 req-26c356de-5022-4d3b-b39f-6f9fb2982223 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:27.568485 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-a1f7115b-ccd1-4764-ad31-ac3724846ba9 req-26c356de-5022-4d3b-b39f-6f9fb2982223 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:27.581107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-a1f7115b-ccd1-4764-ad31-ac3724846ba9 req-26c356de-5022-4d3b-b39f-6f9fb2982223 service nova] Creating event network-changed:39a2bbdc-cbb4-47cf-8e60-ceacd2a33a82 for instance 05c0144f-361b-4c15-813d-6c7b190ff600 on hv-cinder-75510 Jun 06 13:09:27.586363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-a1f7115b-ccd1-4764-ad31-ac3724846ba9 req-26c356de-5022-4d3b-b39f-6f9fb2982223 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031400 Jun 06 13:09:27.594205 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 87/182] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:09:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:09:28.206192 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-375eb48a-3410-476f-9d64-521adf148a35 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:28.207057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-375eb48a-3410-476f-9d64-521adf148a35 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:28.224260 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-375eb48a-3410-476f-9d64-521adf148a35 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:28.224724 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-375eb48a-3410-476f-9d64-521adf148a35 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:28.225503 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-375eb48a-3410-476f-9d64-521adf148a35 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:28.225965 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-375eb48a-3410-476f-9d64-521adf148a35 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:28.555086 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5c38bbf1-c113-4116-8e4a-2ba63f5722ab tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:28.556088 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5c38bbf1-c113-4116-8e4a-2ba63f5722ab tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:28.566275 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c38bbf1-c113-4116-8e4a-2ba63f5722ab tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:28.568307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c38bbf1-c113-4116-8e4a-2ba63f5722ab tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:28.572359 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c38bbf1-c113-4116-8e4a-2ba63f5722ab tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:28.573052 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c38bbf1-c113-4116-8e4a-2ba63f5722ab tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:28.585520 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-375eb48a-3410-476f-9d64-521adf148a35 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:28.595347 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-375eb48a-3410-476f-9d64-521adf148a35 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1554 microversion: 2.1 time: 0.394197 Jun 06 13:09:28.596498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 96/183] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:28 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1554 bytes in 396 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:28.794734 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5c38bbf1-c113-4116-8e4a-2ba63f5722ab tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:28.803809 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5c38bbf1-c113-4116-8e4a-2ba63f5722ab tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.253193 Jun 06 13:09:28.814683 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 88/184] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:28 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:29.613233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2493fc90-f6a2-4fc2-9af8-fe1a0cb59763 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:29.614448 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2493fc90-f6a2-4fc2-9af8-fe1a0cb59763 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:29.621394 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2493fc90-f6a2-4fc2-9af8-fe1a0cb59763 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:29.622091 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2493fc90-f6a2-4fc2-9af8-fe1a0cb59763 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:29.625063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2493fc90-f6a2-4fc2-9af8-fe1a0cb59763 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:29.625063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2493fc90-f6a2-4fc2-9af8-fe1a0cb59763 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:29.825615 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-16be2d53-0717-40b1-aafd-d863ad8acff0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:29.826464 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-16be2d53-0717-40b1-aafd-d863ad8acff0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:29.836999 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-16be2d53-0717-40b1-aafd-d863ad8acff0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:29.843921 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2493fc90-f6a2-4fc2-9af8-fe1a0cb59763 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:29.845101 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-16be2d53-0717-40b1-aafd-d863ad8acff0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:29.846046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-16be2d53-0717-40b1-aafd-d863ad8acff0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:29.846782 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-16be2d53-0717-40b1-aafd-d863ad8acff0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:29.859306 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2493fc90-f6a2-4fc2-9af8-fe1a0cb59763 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1554 microversion: 2.1 time: 0.250043 Jun 06 13:09:29.860800 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 97/185] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:29 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1554 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:30.119919 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-d1813acf-38a7-48c7-b506-6d968d01c81d req-a13d0627-360d-4ca0-a97a-0fe8b72a7e44 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2ca237b6-d9b3-4420-92b7-91ae38b22019", "name": "network-vif-deleted", "tag": "163f5462-d72e-4328-9007-6885d911502a"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:09:30.120091 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-16be2d53-0717-40b1-aafd-d863ad8acff0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:30.129512 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-d1813acf-38a7-48c7-b506-6d968d01c81d req-a13d0627-360d-4ca0-a97a-0fe8b72a7e44 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:30.129512 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-d1813acf-38a7-48c7-b506-6d968d01c81d req-a13d0627-360d-4ca0-a97a-0fe8b72a7e44 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:30.130443 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-16be2d53-0717-40b1-aafd-d863ad8acff0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.309262 Jun 06 13:09:30.131254 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 89/186] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:29 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:30.134801 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:30.145412 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-d1813acf-38a7-48c7-b506-6d968d01c81d req-a13d0627-360d-4ca0-a97a-0fe8b72a7e44 service nova] Creating event network-vif-deleted:163f5462-d72e-4328-9007-6885d911502a for instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 on hv-cinder-75510 Jun 06 13:09:30.152111 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-d1813acf-38a7-48c7-b506-6d968d01c81d req-a13d0627-360d-4ca0-a97a-0fe8b72a7e44 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037700 Jun 06 13:09:30.153658 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 98/187] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:09:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:09:30.877154 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-89476f2f-1c27-40bf-8b5b-44f222283281 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:30.877788 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-89476f2f-1c27-40bf-8b5b-44f222283281 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:30.885221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-89476f2f-1c27-40bf-8b5b-44f222283281 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:30.885669 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-89476f2f-1c27-40bf-8b5b-44f222283281 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:30.886430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-89476f2f-1c27-40bf-8b5b-44f222283281 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:30.886862 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-89476f2f-1c27-40bf-8b5b-44f222283281 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:30.952313 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-89476f2f-1c27-40bf-8b5b-44f222283281 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:30.960457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-89476f2f-1c27-40bf-8b5b-44f222283281 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1512 microversion: 2.1 time: 0.087211 Jun 06 13:09:30.961021 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 90/188] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:30 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1512 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:31.149552 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f942ee79-70e1-4785-a530-c01b9e70e851 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:31.150411 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f942ee79-70e1-4785-a530-c01b9e70e851 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:31.157373 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f942ee79-70e1-4785-a530-c01b9e70e851 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:31.157817 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f942ee79-70e1-4785-a530-c01b9e70e851 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:31.158618 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f942ee79-70e1-4785-a530-c01b9e70e851 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:31.159093 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f942ee79-70e1-4785-a530-c01b9e70e851 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:31.287252 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f942ee79-70e1-4785-a530-c01b9e70e851 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:31.295720 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f942ee79-70e1-4785-a530-c01b9e70e851 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.150610 Jun 06 13:09:31.296251 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 99/189] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:31 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:31.977822 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-367ac0d0-ef34-482b-b67d-95bdd91225e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:31.978653 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-367ac0d0-ef34-482b-b67d-95bdd91225e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:31.985191 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-367ac0d0-ef34-482b-b67d-95bdd91225e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:31.985638 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-367ac0d0-ef34-482b-b67d-95bdd91225e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:31.986410 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-367ac0d0-ef34-482b-b67d-95bdd91225e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:31.986851 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-367ac0d0-ef34-482b-b67d-95bdd91225e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:32.049465 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-367ac0d0-ef34-482b-b67d-95bdd91225e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:32.057647 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-367ac0d0-ef34-482b-b67d-95bdd91225e8 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1512 microversion: 2.1 time: 0.083765 Jun 06 13:09:32.058152 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 91/190] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:31 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1512 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:32.313054 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-117364d0-0b66-4472-b026-d5446d1c1684 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:32.313592 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-117364d0-0b66-4472-b026-d5446d1c1684 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:32.320080 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-117364d0-0b66-4472-b026-d5446d1c1684 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:32.320533 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-117364d0-0b66-4472-b026-d5446d1c1684 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:32.321935 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-117364d0-0b66-4472-b026-d5446d1c1684 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:32.322376 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-117364d0-0b66-4472-b026-d5446d1c1684 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:32.455476 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-117364d0-0b66-4472-b026-d5446d1c1684 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:32.464056 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-117364d0-0b66-4472-b026-d5446d1c1684 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.154838 Jun 06 13:09:32.474000 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 100/191] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:32 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:33.081379 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-7360fcd6-7922-4518-8e1c-74cc0b31f97d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:33.081379 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-7360fcd6-7922-4518-8e1c-74cc0b31f97d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:33.085211 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7360fcd6-7922-4518-8e1c-74cc0b31f97d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:33.085539 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7360fcd6-7922-4518-8e1c-74cc0b31f97d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:33.087307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7360fcd6-7922-4518-8e1c-74cc0b31f97d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:33.087610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7360fcd6-7922-4518-8e1c-74cc0b31f97d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:33.153424 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-7360fcd6-7922-4518-8e1c-74cc0b31f97d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:33.162254 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-7360fcd6-7922-4518-8e1c-74cc0b31f97d tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1346 microversion: 2.1 time: 0.088318 Jun 06 13:09:33.162852 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 92/192] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:33 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1346 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:33.480353 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f00f30ae-16d1-4907-97cc-fef8cb982983 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:33.481043 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f00f30ae-16d1-4907-97cc-fef8cb982983 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:33.487304 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f00f30ae-16d1-4907-97cc-fef8cb982983 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:33.487875 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f00f30ae-16d1-4907-97cc-fef8cb982983 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:33.488810 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f00f30ae-16d1-4907-97cc-fef8cb982983 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:33.489416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f00f30ae-16d1-4907-97cc-fef8cb982983 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:33.649834 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f00f30ae-16d1-4907-97cc-fef8cb982983 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:33.659960 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f00f30ae-16d1-4907-97cc-fef8cb982983 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.183467 Jun 06 13:09:33.660636 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 101/193] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:33 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:34.180152 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-04f2b2ce-774c-4395-b665-eeccbe814bee tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:34.181466 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-04f2b2ce-774c-4395-b665-eeccbe814bee tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:34.188889 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04f2b2ce-774c-4395-b665-eeccbe814bee tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:34.189089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04f2b2ce-774c-4395-b665-eeccbe814bee tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:34.189940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04f2b2ce-774c-4395-b665-eeccbe814bee tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:34.190365 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04f2b2ce-774c-4395-b665-eeccbe814bee tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:34.223724 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04f2b2ce-774c-4395-b665-eeccbe814bee tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:34.224161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04f2b2ce-774c-4395-b665-eeccbe814bee tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:34.224610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-04f2b2ce-774c-4395-b665-eeccbe814bee tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lazy-loading 'fault' on Instance uuid 2ca237b6-d9b3-4420-92b7-91ae38b22019 {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:09:34.277759 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-04f2b2ce-774c-4395-b665-eeccbe814bee tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '6c12284a3fb845a5b6c073fcb98913ee', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9e72dd6caaa243f9ac9989f766976e30', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:34.286619 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-04f2b2ce-774c-4395-b665-eeccbe814bee tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 200 len: 1351 microversion: 2.1 time: 0.110431 Jun 06 13:09:34.287337 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 93/194] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:34 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 1351 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:34.677405 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-19a17c1d-8ad6-484b-a666-42a7f87e30a8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:34.677950 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-19a17c1d-8ad6-484b-a666-42a7f87e30a8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:34.686390 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-19a17c1d-8ad6-484b-a666-42a7f87e30a8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:34.686831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-19a17c1d-8ad6-484b-a666-42a7f87e30a8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:34.687634 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-19a17c1d-8ad6-484b-a666-42a7f87e30a8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:34.688066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-19a17c1d-8ad6-484b-a666-42a7f87e30a8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:34.815998 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-19a17c1d-8ad6-484b-a666-42a7f87e30a8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:34.823924 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-19a17c1d-8ad6-484b-a666-42a7f87e30a8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.150420 Jun 06 13:09:34.824497 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 102/195] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:34 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:35.314528 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bbf1b331-ff74-4a3f-a1df-dbc3e2056ab3 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:35.315176 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-bbf1b331-ff74-4a3f-a1df-dbc3e2056ab3 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:35.322439 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bbf1b331-ff74-4a3f-a1df-dbc3e2056ab3 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:35.322890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bbf1b331-ff74-4a3f-a1df-dbc3e2056ab3 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:35.323676 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bbf1b331-ff74-4a3f-a1df-dbc3e2056ab3 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:35.324107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bbf1b331-ff74-4a3f-a1df-dbc3e2056ab3 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:35.337264 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-bbf1b331-ff74-4a3f-a1df-dbc3e2056ab3 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] HTTP exception thrown: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bbf1b331-ff74-4a3f-a1df-dbc3e2056ab3 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Request method failure captured: Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 HTTP/1.1 Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxH10BcxkRqgbnoGi7nn6Pgt94yr0tOHwzxrufM6DOnLEb14odA0K-n6znRxv8rm04wLTQ4HIriCQ5E4J_TO0FC1aHOToYlARZhFxn5PYbijfADFrL_q4FIA6pnr3He_zFU1fFHVN8rxQKjiwEpOSTPjCBR2H-TsaqkVw9mi2QJzTs Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 9e72dd6caaa243f9ac9989f766976e30 Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-DeleteServersTestJSON-185428377 Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:09:35.341870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:09:35.343369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9e72dd6caaa243f9ac9989f766976e30", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e72dd6caaa243f9ac9989f766976e30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e72dd6caaa243f9ac9989f766976e30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9e72dd6caaa243f9ac9989f766976e30"}]}] Jun 06 13:09:35.343369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-DeleteServersTestJSON-185428377 Jun 06 13:09:35.343369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 9e72dd6caaa243f9ac9989f766976e30 Jun 06 13:09:35.343369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-DeleteServersTestJSON-185428377 Jun 06 13:09:35.343369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-DeleteServersTestJSON-185428377-project Jun 06 13:09:35.343369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:09:35.343369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:09:35.343369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 6c12284a3fb845a5b6c073fcb98913ee Jun 06 13:09:35.343369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-DeleteServersTestJSON-185428377-project Jun 06 13:09:35.343369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:09:35.343369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:35.343369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '2ca237b6-d9b3-4420-92b7-91ae38b22019'} Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:09:35.344183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:35.345299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:09:35.346306 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bbf1b331-ff74-4a3f-a1df-dbc3e2056ab3 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Returning 404 to user: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:09:35.346306 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-bbf1b331-ff74-4a3f-a1df-dbc3e2056ab3 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 404 len: 111 microversion: 2.1 time: 0.032650 Jun 06 13:09:35.346306 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 94/196] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:35 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:09:35.479386 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9e334f81-62cf-4188-931b-e759357fcc22 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:35.480399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9e334f81-62cf-4188-931b-e759357fcc22 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:35.487565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9e334f81-62cf-4188-931b-e759357fcc22 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:35.488038 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9e334f81-62cf-4188-931b-e759357fcc22 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:35.488857 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9e334f81-62cf-4188-931b-e759357fcc22 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:35.489453 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9e334f81-62cf-4188-931b-e759357fcc22 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:35.503949 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-9e334f81-62cf-4188-931b-e759357fcc22 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] HTTP exception thrown: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9e334f81-62cf-4188-931b-e759357fcc22 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Request method failure captured: Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019/os-volume_attachments HTTP/1.1 Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxH10BcxkRqgbnoGi7nn6Pgt94yr0tOHwzxrufM6DOnLEb14odA0K-n6znRxv8rm04wLTQ4HIriCQ5E4J_TO0FC1aHOToYlARZhFxn5PYbijfADFrL_q4FIA6pnr3He_zFU1fFHVN8rxQKjiwEpOSTPjCBR2H-TsaqkVw9mi2QJzTs Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: 9e72dd6caaa243f9ac9989f766976e30 Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-DeleteServersTestJSON-185428377 Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:09:35.510729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:09:35.512485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9e72dd6caaa243f9ac9989f766976e30", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e72dd6caaa243f9ac9989f766976e30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e72dd6caaa243f9ac9989f766976e30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9e72dd6caaa243f9ac9989f766976e30"}]}] Jun 06 13:09:35.512485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-DeleteServersTestJSON-185428377 Jun 06 13:09:35.512485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 9e72dd6caaa243f9ac9989f766976e30 Jun 06 13:09:35.512485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-DeleteServersTestJSON-185428377 Jun 06 13:09:35.512485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-DeleteServersTestJSON-185428377-project Jun 06 13:09:35.512485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:09:35.512485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:09:35.512485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 6c12284a3fb845a5b6c073fcb98913ee Jun 06 13:09:35.512485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-DeleteServersTestJSON-185428377-project Jun 06 13:09:35.512485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:09:35.512485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:35.512485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'server_id': '2ca237b6-d9b3-4420-92b7-91ae38b22019'} Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:09:35.513314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:35.514905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:09:35.516254 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9e334f81-62cf-4188-931b-e759357fcc22 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Returning 404 to user: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:09:35.516254 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9e334f81-62cf-4188-931b-e759357fcc22 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038125 Jun 06 13:09:35.516254 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 103/197] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:09:35 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:09:35.843002 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-245bbaba-18d1-45b8-8125-a032f1972cda tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:35.844197 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-245bbaba-18d1-45b8-8125-a032f1972cda tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:35.851831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-245bbaba-18d1-45b8-8125-a032f1972cda tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:35.856538 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-245bbaba-18d1-45b8-8125-a032f1972cda tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:35.856538 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-245bbaba-18d1-45b8-8125-a032f1972cda tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:35.856538 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-245bbaba-18d1-45b8-8125-a032f1972cda tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:36.069795 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-245bbaba-18d1-45b8-8125-a032f1972cda tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:36.087493 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-245bbaba-18d1-45b8-8125-a032f1972cda tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.250776 Jun 06 13:09:36.088261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 95/198] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:35 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:36.941130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c172efa5-5d1d-428a-8c75-2ca244c8955c tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:36.941629 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c172efa5-5d1d-428a-8c75-2ca244c8955c tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:36.948201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c172efa5-5d1d-428a-8c75-2ca244c8955c tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:36.948650 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c172efa5-5d1d-428a-8c75-2ca244c8955c tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:36.949410 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c172efa5-5d1d-428a-8c75-2ca244c8955c tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:36.949841 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c172efa5-5d1d-428a-8c75-2ca244c8955c tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:36.964047 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-c172efa5-5d1d-428a-8c75-2ca244c8955c tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] HTTP exception thrown: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c172efa5-5d1d-428a-8c75-2ca244c8955c tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Request method failure captured: Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 HTTP/1.1 Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxH10BcxkRqgbnoGi7nn6Pgt94yr0tOHwzxrufM6DOnLEb14odA0K-n6znRxv8rm04wLTQ4HIriCQ5E4J_TO0FC1aHOToYlARZhFxn5PYbijfADFrL_q4FIA6pnr3He_zFU1fFHVN8rxQKjiwEpOSTPjCBR2H-TsaqkVw9mi2QJzTs Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: 9e72dd6caaa243f9ac9989f766976e30 Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-DeleteServersTestJSON-185428377 Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:09:36.966202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:09:36.967717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9e72dd6caaa243f9ac9989f766976e30", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e72dd6caaa243f9ac9989f766976e30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e72dd6caaa243f9ac9989f766976e30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9e72dd6caaa243f9ac9989f766976e30"}]}] Jun 06 13:09:36.967717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-DeleteServersTestJSON-185428377 Jun 06 13:09:36.967717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 9e72dd6caaa243f9ac9989f766976e30 Jun 06 13:09:36.967717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-DeleteServersTestJSON-185428377 Jun 06 13:09:36.967717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-DeleteServersTestJSON-185428377-project Jun 06 13:09:36.967717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:09:36.967717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:09:36.967717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 6c12284a3fb845a5b6c073fcb98913ee Jun 06 13:09:36.967717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-DeleteServersTestJSON-185428377-project Jun 06 13:09:36.967717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:09:36.967717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:36.967717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': '2ca237b6-d9b3-4420-92b7-91ae38b22019'} Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:09:36.968486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:36.969748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:09:36.970899 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c172efa5-5d1d-428a-8c75-2ca244c8955c tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Returning 404 to user: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:09:36.970899 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c172efa5-5d1d-428a-8c75-2ca244c8955c tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "DELETE /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 404 len: 111 microversion: 2.1 time: 0.030395 Jun 06 13:09:36.970899 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 104/199] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:09:36 2022] DELETE /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:09:36.975993 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2b1926d3-b759-400c-8cfc-29e71a899744 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:36.976603 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2b1926d3-b759-400c-8cfc-29e71a899744 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] [instance: 2ca237b6-d9b3-4420-92b7-91ae38b22019] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:36.984021 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b1926d3-b759-400c-8cfc-29e71a899744 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:36.986013 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b1926d3-b759-400c-8cfc-29e71a899744 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:36.986013 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b1926d3-b759-400c-8cfc-29e71a899744 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:36.986013 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b1926d3-b759-400c-8cfc-29e71a899744 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:36.999128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-2b1926d3-b759-400c-8cfc-29e71a899744 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] HTTP exception thrown: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2b1926d3-b759-400c-8cfc-29e71a899744 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Request method failure captured: Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 HTTP/1.1 Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxH10BcxkRqgbnoGi7nn6Pgt94yr0tOHwzxrufM6DOnLEb14odA0K-n6znRxv8rm04wLTQ4HIriCQ5E4J_TO0FC1aHOToYlARZhFxn5PYbijfADFrL_q4FIA6pnr3He_zFU1fFHVN8rxQKjiwEpOSTPjCBR2H-TsaqkVw9mi2QJzTs Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 9e72dd6caaa243f9ac9989f766976e30 Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-DeleteServersTestJSON-185428377 Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:09:37.000651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:09:37.002061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_9e72dd6caaa243f9ac9989f766976e30", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e72dd6caaa243f9ac9989f766976e30"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/9e72dd6caaa243f9ac9989f766976e30"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/9e72dd6caaa243f9ac9989f766976e30"}]}] Jun 06 13:09:37.002061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-DeleteServersTestJSON-185428377 Jun 06 13:09:37.002061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 9e72dd6caaa243f9ac9989f766976e30 Jun 06 13:09:37.002061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-DeleteServersTestJSON-185428377 Jun 06 13:09:37.002061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-DeleteServersTestJSON-185428377-project Jun 06 13:09:37.002061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:09:37.002061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:09:37.002061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 6c12284a3fb845a5b6c073fcb98913ee Jun 06 13:09:37.002061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-DeleteServersTestJSON-185428377-project Jun 06 13:09:37.002061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:09:37.002061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:37.002061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '2ca237b6-d9b3-4420-92b7-91ae38b22019'} Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:09:37.002905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. Jun 06 13:09:37.015261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:09:37.016798 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2b1926d3-b759-400c-8cfc-29e71a899744 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] Returning 404 to user: Instance 2ca237b6-d9b3-4420-92b7-91ae38b22019 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:09:37.016798 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2b1926d3-b759-400c-8cfc-29e71a899744 tempest-DeleteServersTestJSON-185428377 tempest-DeleteServersTestJSON-185428377-project] 10.222.0.13 "GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019" status: 404 len: 111 microversion: 2.1 time: 0.029840 Jun 06 13:09:37.016798 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 96/200] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:36 2022] GET /compute/v2.1/servers/2ca237b6-d9b3-4420-92b7-91ae38b22019 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:09:37.105682 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7317759c-4ae4-4be0-99fe-d87d5acfcf64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:37.106569 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7317759c-4ae4-4be0-99fe-d87d5acfcf64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:37.112444 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7317759c-4ae4-4be0-99fe-d87d5acfcf64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:37.112830 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7317759c-4ae4-4be0-99fe-d87d5acfcf64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:37.113595 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7317759c-4ae4-4be0-99fe-d87d5acfcf64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:37.114026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7317759c-4ae4-4be0-99fe-d87d5acfcf64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:37.250888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7317759c-4ae4-4be0-99fe-d87d5acfcf64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:37.259138 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7317759c-4ae4-4be0-99fe-d87d5acfcf64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.157652 Jun 06 13:09:37.263560 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 105/201] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:37 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:38.275989 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1f5675dd-3448-4add-a0f6-6b68c71650b7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:38.276595 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1f5675dd-3448-4add-a0f6-6b68c71650b7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:38.287825 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1f5675dd-3448-4add-a0f6-6b68c71650b7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:38.288274 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1f5675dd-3448-4add-a0f6-6b68c71650b7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:38.289044 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1f5675dd-3448-4add-a0f6-6b68c71650b7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:38.289546 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1f5675dd-3448-4add-a0f6-6b68c71650b7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:38.522952 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1f5675dd-3448-4add-a0f6-6b68c71650b7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:38.538240 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1f5675dd-3448-4add-a0f6-6b68c71650b7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.264821 Jun 06 13:09:38.540189 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 97/202] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:38 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:39.557389 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ee396303-83ad-4789-8291-4c35589cd65b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:39.557985 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ee396303-83ad-4789-8291-4c35589cd65b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:39.564330 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ee396303-83ad-4789-8291-4c35589cd65b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:39.564776 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ee396303-83ad-4789-8291-4c35589cd65b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:39.565533 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ee396303-83ad-4789-8291-4c35589cd65b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:39.565961 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ee396303-83ad-4789-8291-4c35589cd65b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:39.733272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ee396303-83ad-4789-8291-4c35589cd65b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:39.740806 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ee396303-83ad-4789-8291-4c35589cd65b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.188049 Jun 06 13:09:39.741375 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 106/203] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:39 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:40.758720 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-7b174d3e-92e5-434c-b53a-f06b8b040d08 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:40.759409 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-7b174d3e-92e5-434c-b53a-f06b8b040d08 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:40.774158 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b174d3e-92e5-434c-b53a-f06b8b040d08 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:40.774158 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b174d3e-92e5-434c-b53a-f06b8b040d08 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:40.774158 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b174d3e-92e5-434c-b53a-f06b8b040d08 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:40.774158 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b174d3e-92e5-434c-b53a-f06b8b040d08 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:40.908870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-7b174d3e-92e5-434c-b53a-f06b8b040d08 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:40.917984 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-7b174d3e-92e5-434c-b53a-f06b8b040d08 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.163727 Jun 06 13:09:40.918559 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 98/204] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:40 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:41.934824 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-07b3577b-28ee-4ec6-a44b-0b55dbc2b560 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:41.935495 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-07b3577b-28ee-4ec6-a44b-0b55dbc2b560 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:41.938598 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:41.942295 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-07b3577b-28ee-4ec6-a44b-0b55dbc2b560 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:41.942739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-07b3577b-28ee-4ec6-a44b-0b55dbc2b560 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:41.943551 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-07b3577b-28ee-4ec6-a44b-0b55dbc2b560 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:41.944006 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-07b3577b-28ee-4ec6-a44b-0b55dbc2b560 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:42.104196 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-07b3577b-28ee-4ec6-a44b-0b55dbc2b560 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:42.114865 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-07b3577b-28ee-4ec6-a44b-0b55dbc2b560 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.183870 Jun 06 13:09:42.115758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 107/205] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:41 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:43.134148 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b32d4bc9-08ca-4a44-841c-393e0863c041 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:43.135790 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b32d4bc9-08ca-4a44-841c-393e0863c041 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:43.142815 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b32d4bc9-08ca-4a44-841c-393e0863c041 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:43.143339 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b32d4bc9-08ca-4a44-841c-393e0863c041 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:43.144203 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b32d4bc9-08ca-4a44-841c-393e0863c041 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:43.144703 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b32d4bc9-08ca-4a44-841c-393e0863c041 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:43.280595 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b32d4bc9-08ca-4a44-841c-393e0863c041 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:43.288236 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b32d4bc9-08ca-4a44-841c-393e0863c041 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.158575 Jun 06 13:09:43.289395 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 99/206] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:43 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:44.306301 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-db7f177f-5d22-4d99-9b37-15e1ac3e7043 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:44.306949 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-db7f177f-5d22-4d99-9b37-15e1ac3e7043 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:44.313875 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-db7f177f-5d22-4d99-9b37-15e1ac3e7043 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:44.314370 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-db7f177f-5d22-4d99-9b37-15e1ac3e7043 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:44.315138 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-db7f177f-5d22-4d99-9b37-15e1ac3e7043 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:44.315578 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-db7f177f-5d22-4d99-9b37-15e1ac3e7043 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:44.486797 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-db7f177f-5d22-4d99-9b37-15e1ac3e7043 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:44.501402 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-db7f177f-5d22-4d99-9b37-15e1ac3e7043 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.200097 Jun 06 13:09:44.502197 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 108/207] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:44 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:45.520367 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5b471161-75cf-4955-b8fa-844c2bb3cf04 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:45.520367 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5b471161-75cf-4955-b8fa-844c2bb3cf04 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:45.534014 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5b471161-75cf-4955-b8fa-844c2bb3cf04 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:45.534014 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5b471161-75cf-4955-b8fa-844c2bb3cf04 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:45.534014 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5b471161-75cf-4955-b8fa-844c2bb3cf04 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:45.534014 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5b471161-75cf-4955-b8fa-844c2bb3cf04 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:45.548757 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=100 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:45.685224 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5b471161-75cf-4955-b8fa-844c2bb3cf04 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:45.693534 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5b471161-75cf-4955-b8fa-844c2bb3cf04 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.177573 Jun 06 13:09:45.694082 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 100/208] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:45 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:46.714058 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fdef7d08-a2d2-4677-a202-089c4ca7778f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:46.715176 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fdef7d08-a2d2-4677-a202-089c4ca7778f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:46.731214 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fdef7d08-a2d2-4677-a202-089c4ca7778f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:46.731813 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fdef7d08-a2d2-4677-a202-089c4ca7778f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:46.732726 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fdef7d08-a2d2-4677-a202-089c4ca7778f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:46.733201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fdef7d08-a2d2-4677-a202-089c4ca7778f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:46.883909 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fdef7d08-a2d2-4677-a202-089c4ca7778f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:46.893627 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fdef7d08-a2d2-4677-a202-089c4ca7778f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.186290 Jun 06 13:09:46.893627 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 109/209] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:46 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:47.910043 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d324b18f-9f93-40a3-b6d1-8dd69f2debf1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:47.910650 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d324b18f-9f93-40a3-b6d1-8dd69f2debf1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:47.915226 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=70 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:09:47.919319 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d324b18f-9f93-40a3-b6d1-8dd69f2debf1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:47.919881 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d324b18f-9f93-40a3-b6d1-8dd69f2debf1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:47.920658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d324b18f-9f93-40a3-b6d1-8dd69f2debf1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:47.921090 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d324b18f-9f93-40a3-b6d1-8dd69f2debf1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:48.069327 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d324b18f-9f93-40a3-b6d1-8dd69f2debf1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:48.085537 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d324b18f-9f93-40a3-b6d1-8dd69f2debf1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.178774 Jun 06 13:09:48.086236 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 101/210] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:47 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:49.105173 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0ccc4dcf-8c59-4bb7-bff1-77551c3e6f54 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:49.106352 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0ccc4dcf-8c59-4bb7-bff1-77551c3e6f54 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:49.112795 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ccc4dcf-8c59-4bb7-bff1-77551c3e6f54 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:49.113321 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ccc4dcf-8c59-4bb7-bff1-77551c3e6f54 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:49.114123 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ccc4dcf-8c59-4bb7-bff1-77551c3e6f54 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:49.114557 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ccc4dcf-8c59-4bb7-bff1-77551c3e6f54 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:49.256220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0ccc4dcf-8c59-4bb7-bff1-77551c3e6f54 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:49.264825 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0ccc4dcf-8c59-4bb7-bff1-77551c3e6f54 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.165866 Jun 06 13:09:49.265267 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 110/211] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:49 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:50.284522 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d3fa05d2-e20f-41dc-98c9-39c868fc7863 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:50.286361 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d3fa05d2-e20f-41dc-98c9-39c868fc7863 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:50.312046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d3fa05d2-e20f-41dc-98c9-39c868fc7863 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:50.312046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d3fa05d2-e20f-41dc-98c9-39c868fc7863 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:50.312046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d3fa05d2-e20f-41dc-98c9-39c868fc7863 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:50.312046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d3fa05d2-e20f-41dc-98c9-39c868fc7863 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:50.437855 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d3fa05d2-e20f-41dc-98c9-39c868fc7863 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:50.446162 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d3fa05d2-e20f-41dc-98c9-39c868fc7863 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.167047 Jun 06 13:09:50.447032 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 102/212] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:50 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:09:51.472617 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-aee9a59f-28c8-4807-a14a-e51e0e47e58c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:51.473258 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-aee9a59f-28c8-4807-a14a-e51e0e47e58c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:51.491182 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aee9a59f-28c8-4807-a14a-e51e0e47e58c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:51.491663 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aee9a59f-28c8-4807-a14a-e51e0e47e58c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:51.492563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aee9a59f-28c8-4807-a14a-e51e0e47e58c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:51.492851 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aee9a59f-28c8-4807-a14a-e51e0e47e58c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:51.633107 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-aee9a59f-28c8-4807-a14a-e51e0e47e58c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:51.641097 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-aee9a59f-28c8-4807-a14a-e51e0e47e58c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.181562 Jun 06 13:09:51.641663 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 111/213] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:51 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:52.657551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6129ebe3-ca22-40dd-ae31-99c423630dd3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:52.658154 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6129ebe3-ca22-40dd-ae31-99c423630dd3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:52.664478 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6129ebe3-ca22-40dd-ae31-99c423630dd3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:52.675135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6129ebe3-ca22-40dd-ae31-99c423630dd3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:52.675135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6129ebe3-ca22-40dd-ae31-99c423630dd3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:52.675135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6129ebe3-ca22-40dd-ae31-99c423630dd3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:52.814493 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6129ebe3-ca22-40dd-ae31-99c423630dd3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:52.823175 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6129ebe3-ca22-40dd-ae31-99c423630dd3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.169297 Jun 06 13:09:52.824102 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 103/214] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:52 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:53.840692 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-45bf9e91-25eb-498d-95ad-6033f51807a7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:53.841294 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-45bf9e91-25eb-498d-95ad-6033f51807a7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:53.847277 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45bf9e91-25eb-498d-95ad-6033f51807a7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:53.847703 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45bf9e91-25eb-498d-95ad-6033f51807a7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:53.848489 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45bf9e91-25eb-498d-95ad-6033f51807a7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:53.848918 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45bf9e91-25eb-498d-95ad-6033f51807a7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:53.982463 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-45bf9e91-25eb-498d-95ad-6033f51807a7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:53.990428 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-45bf9e91-25eb-498d-95ad-6033f51807a7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.153885 Jun 06 13:09:53.991056 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 112/215] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:53 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:55.007289 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ad36752c-33fd-4d43-afc6-bf5105204be6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:55.007977 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ad36752c-33fd-4d43-afc6-bf5105204be6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:55.015130 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ad36752c-33fd-4d43-afc6-bf5105204be6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:55.015605 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ad36752c-33fd-4d43-afc6-bf5105204be6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:55.016616 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ad36752c-33fd-4d43-afc6-bf5105204be6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:55.017240 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ad36752c-33fd-4d43-afc6-bf5105204be6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:55.171416 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ad36752c-33fd-4d43-afc6-bf5105204be6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:55.179860 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ad36752c-33fd-4d43-afc6-bf5105204be6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.176370 Jun 06 13:09:55.180503 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 104/216] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:55 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:56.197001 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-26dc97c8-eff8-4915-8831-562bedb4d519 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:56.197609 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-26dc97c8-eff8-4915-8831-562bedb4d519 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:56.203792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-26dc97c8-eff8-4915-8831-562bedb4d519 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:56.204233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-26dc97c8-eff8-4915-8831-562bedb4d519 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:56.204984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-26dc97c8-eff8-4915-8831-562bedb4d519 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:56.205408 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-26dc97c8-eff8-4915-8831-562bedb4d519 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:56.339288 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-26dc97c8-eff8-4915-8831-562bedb4d519 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:56.347020 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-26dc97c8-eff8-4915-8831-562bedb4d519 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.154034 Jun 06 13:09:56.347627 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 113/217] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:56 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:57.363321 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3ecc4ea4-307e-46cf-bb1e-92b8fd8b2c41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:57.364076 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3ecc4ea4-307e-46cf-bb1e-92b8fd8b2c41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:57.372204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3ecc4ea4-307e-46cf-bb1e-92b8fd8b2c41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:57.372812 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3ecc4ea4-307e-46cf-bb1e-92b8fd8b2c41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:57.373702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3ecc4ea4-307e-46cf-bb1e-92b8fd8b2c41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:57.374244 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3ecc4ea4-307e-46cf-bb1e-92b8fd8b2c41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:57.554165 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3ecc4ea4-307e-46cf-bb1e-92b8fd8b2c41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:57.565392 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3ecc4ea4-307e-46cf-bb1e-92b8fd8b2c41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.206061 Jun 06 13:09:57.566048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 105/218] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:57 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:58.582033 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4e2a99b7-7199-4cb6-8053-7a4f249c5cbf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:58.586766 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4e2a99b7-7199-4cb6-8053-7a4f249c5cbf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:58.588891 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e2a99b7-7199-4cb6-8053-7a4f249c5cbf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:58.589331 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e2a99b7-7199-4cb6-8053-7a4f249c5cbf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:58.590084 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e2a99b7-7199-4cb6-8053-7a4f249c5cbf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:58.590513 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e2a99b7-7199-4cb6-8053-7a4f249c5cbf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:58.726630 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4e2a99b7-7199-4cb6-8053-7a4f249c5cbf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:58.734243 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4e2a99b7-7199-4cb6-8053-7a4f249c5cbf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.156079 Jun 06 13:09:58.734807 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 114/219] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:58 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:09:59.750704 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-43f24d45-81f0-4e3a-a287-51908a3ff281 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:09:59.751424 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-43f24d45-81f0-4e3a-a287-51908a3ff281 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:09:59.757959 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-43f24d45-81f0-4e3a-a287-51908a3ff281 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:59.759497 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-43f24d45-81f0-4e3a-a287-51908a3ff281 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:59.760300 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-43f24d45-81f0-4e3a-a287-51908a3ff281 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:09:59.760808 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-43f24d45-81f0-4e3a-a287-51908a3ff281 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:09:59.890264 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-43f24d45-81f0-4e3a-a287-51908a3ff281 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:09:59.897876 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-43f24d45-81f0-4e3a-a287-51908a3ff281 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.150961 Jun 06 13:09:59.898443 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 106/220] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:09:59 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:00.914295 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bec44ec2-c9bb-4385-b8d6-6a49322a984e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:00.915300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bec44ec2-c9bb-4385-b8d6-6a49322a984e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:00.921604 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bec44ec2-c9bb-4385-b8d6-6a49322a984e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:00.922051 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bec44ec2-c9bb-4385-b8d6-6a49322a984e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:00.922817 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bec44ec2-c9bb-4385-b8d6-6a49322a984e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:00.923283 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bec44ec2-c9bb-4385-b8d6-6a49322a984e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:01.057937 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bec44ec2-c9bb-4385-b8d6-6a49322a984e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:01.065420 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bec44ec2-c9bb-4385-b8d6-6a49322a984e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.155072 Jun 06 13:10:01.065976 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 115/221] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:00 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:02.082270 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b47e9d99-1200-42c7-9465-3ea9fafd0bbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:02.082833 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b47e9d99-1200-42c7-9465-3ea9fafd0bbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:02.090356 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b47e9d99-1200-42c7-9465-3ea9fafd0bbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:02.097006 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b47e9d99-1200-42c7-9465-3ea9fafd0bbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:02.097006 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b47e9d99-1200-42c7-9465-3ea9fafd0bbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:02.097006 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b47e9d99-1200-42c7-9465-3ea9fafd0bbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:02.225209 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b47e9d99-1200-42c7-9465-3ea9fafd0bbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:02.233498 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b47e9d99-1200-42c7-9465-3ea9fafd0bbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.155169 Jun 06 13:10:02.234071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 107/222] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:02 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:03.254205 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a8ec7611-c046-405a-a4fe-7691d87da778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:03.254205 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a8ec7611-c046-405a-a4fe-7691d87da778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:03.257350 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8ec7611-c046-405a-a4fe-7691d87da778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:03.257804 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8ec7611-c046-405a-a4fe-7691d87da778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:03.259287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8ec7611-c046-405a-a4fe-7691d87da778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:03.259760 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8ec7611-c046-405a-a4fe-7691d87da778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:03.262391 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=95 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:03.400967 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a8ec7611-c046-405a-a4fe-7691d87da778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:03.408795 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a8ec7611-c046-405a-a4fe-7691d87da778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1523 microversion: 2.1 time: 0.162572 Jun 06 13:10:03.409346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 116/223] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:03 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1523 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:04.426088 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cc151a63-a53e-4ead-91b1-8a7ec691f9ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:04.426703 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-cc151a63-a53e-4ead-91b1-8a7ec691f9ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:04.433474 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cc151a63-a53e-4ead-91b1-8a7ec691f9ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:04.433918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cc151a63-a53e-4ead-91b1-8a7ec691f9ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:04.434695 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cc151a63-a53e-4ead-91b1-8a7ec691f9ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:04.435131 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cc151a63-a53e-4ead-91b1-8a7ec691f9ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:04.580751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cc151a63-a53e-4ead-91b1-8a7ec691f9ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:04.590471 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cc151a63-a53e-4ead-91b1-8a7ec691f9ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1503 microversion: 2.1 time: 0.166826 Jun 06 13:10:04.590471 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 108/224] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:04 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1503 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:04.609056 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4b0d4e20-66d4-4067-b79c-5a1dd2512250 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:04.609669 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4b0d4e20-66d4-4067-b79c-5a1dd2512250 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:04.615747 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4b0d4e20-66d4-4067-b79c-5a1dd2512250 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:04.616464 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4b0d4e20-66d4-4067-b79c-5a1dd2512250 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:04.617105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4b0d4e20-66d4-4067-b79c-5a1dd2512250 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:04.617545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4b0d4e20-66d4-4067-b79c-5a1dd2512250 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:04.780272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4b0d4e20-66d4-4067-b79c-5a1dd2512250 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:04.786392 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4b0d4e20-66d4-4067-b79c-5a1dd2512250 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1516 microversion: 2.1 time: 0.181513 Jun 06 13:10:04.799058 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 117/225] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:04 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1516 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:07.153683 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b14b31c8-d805-4a03-bf0c-c3931a781249 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:07.155765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b14b31c8-d805-4a03-bf0c-c3931a781249 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:07.160715 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b14b31c8-d805-4a03-bf0c-c3931a781249 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:07.161167 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b14b31c8-d805-4a03-bf0c-c3931a781249 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:07.161949 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b14b31c8-d805-4a03-bf0c-c3931a781249 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:07.162386 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b14b31c8-d805-4a03-bf0c-c3931a781249 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:07.185457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-b14b31c8-d805-4a03-bf0c-c3931a781249 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lazy-loading 'flavor' on Instance uuid 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:10:07.494012 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b14b31c8-d805-4a03-bf0c-c3931a781249 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "POST /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108/action" status: 200 len: 32 microversion: 2.1 time: 0.344573 Jun 06 13:10:07.494673 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 109/226] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:10:07 2022] POST /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108/action => generated 32 bytes in 346 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 13:10:07.506180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9f065823-2b4e-449b-b82e-8c9959a24ea2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:07.506180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9f065823-2b4e-449b-b82e-8c9959a24ea2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:07.512002 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f065823-2b4e-449b-b82e-8c9959a24ea2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:07.512461 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f065823-2b4e-449b-b82e-8c9959a24ea2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:07.513487 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f065823-2b4e-449b-b82e-8c9959a24ea2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:07.513827 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f065823-2b4e-449b-b82e-8c9959a24ea2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:07.679747 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9f065823-2b4e-449b-b82e-8c9959a24ea2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:07.686066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9f065823-2b4e-449b-b82e-8c9959a24ea2 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.186273 Jun 06 13:10:07.686652 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 118/227] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:07 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:08.704040 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-838969f3-c382-4ba8-b876-89e8ce798a9d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:08.704739 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-838969f3-c382-4ba8-b876-89e8ce798a9d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:08.710987 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-838969f3-c382-4ba8-b876-89e8ce798a9d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:08.711438 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-838969f3-c382-4ba8-b876-89e8ce798a9d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:08.712240 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-838969f3-c382-4ba8-b876-89e8ce798a9d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:08.712678 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-838969f3-c382-4ba8-b876-89e8ce798a9d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:08.868223 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-838969f3-c382-4ba8-b876-89e8ce798a9d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:08.876425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-838969f3-c382-4ba8-b876-89e8ce798a9d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.177249 Jun 06 13:10:08.876997 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 110/228] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:08 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:09.898147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-14ec664c-8811-4386-9038-c400cea21c92 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:09.899468 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-14ec664c-8811-4386-9038-c400cea21c92 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:09.908820 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-14ec664c-8811-4386-9038-c400cea21c92 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:09.909271 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-14ec664c-8811-4386-9038-c400cea21c92 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:09.910180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-14ec664c-8811-4386-9038-c400cea21c92 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:09.910911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-14ec664c-8811-4386-9038-c400cea21c92 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:10.046715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-14ec664c-8811-4386-9038-c400cea21c92 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:10.055700 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-14ec664c-8811-4386-9038-c400cea21c92 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.163807 Jun 06 13:10:10.056272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 119/229] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:09 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:11.071954 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-794149b5-4a7b-466f-8b1f-d4c98f8bfb3e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:11.073077 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-794149b5-4a7b-466f-8b1f-d4c98f8bfb3e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:11.079639 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-794149b5-4a7b-466f-8b1f-d4c98f8bfb3e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:11.080081 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-794149b5-4a7b-466f-8b1f-d4c98f8bfb3e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:11.080837 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-794149b5-4a7b-466f-8b1f-d4c98f8bfb3e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:11.081262 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-794149b5-4a7b-466f-8b1f-d4c98f8bfb3e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:11.293318 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-794149b5-4a7b-466f-8b1f-d4c98f8bfb3e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:11.301074 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-794149b5-4a7b-466f-8b1f-d4c98f8bfb3e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.232992 Jun 06 13:10:11.301640 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 111/230] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:11 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:12.319108 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-47e9cfc6-20fb-4ed7-8248-9e2670798448 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:12.323632 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-47e9cfc6-20fb-4ed7-8248-9e2670798448 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:12.329908 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47e9cfc6-20fb-4ed7-8248-9e2670798448 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:12.330358 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47e9cfc6-20fb-4ed7-8248-9e2670798448 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:12.331122 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47e9cfc6-20fb-4ed7-8248-9e2670798448 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:12.331571 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47e9cfc6-20fb-4ed7-8248-9e2670798448 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:12.507433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-47e9cfc6-20fb-4ed7-8248-9e2670798448 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:12.521010 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-47e9cfc6-20fb-4ed7-8248-9e2670798448 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.205981 Jun 06 13:10:12.521010 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 120/231] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:12 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:13.538003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-50e0f42b-2d62-41a7-9b45-9f008e4b42fc tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:13.546468 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-50e0f42b-2d62-41a7-9b45-9f008e4b42fc tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:13.546468 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-50e0f42b-2d62-41a7-9b45-9f008e4b42fc tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:13.546814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-50e0f42b-2d62-41a7-9b45-9f008e4b42fc tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:13.548026 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-50e0f42b-2d62-41a7-9b45-9f008e4b42fc tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:13.548695 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-50e0f42b-2d62-41a7-9b45-9f008e4b42fc tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:13.724130 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-50e0f42b-2d62-41a7-9b45-9f008e4b42fc tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:13.731787 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-50e0f42b-2d62-41a7-9b45-9f008e4b42fc tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.197523 Jun 06 13:10:13.735738 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 112/232] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:13 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:14.748562 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f22462ad-d637-4a62-b839-b469c8a69880 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:14.749101 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f22462ad-d637-4a62-b839-b469c8a69880 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:14.751106 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=28 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:14.755857 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f22462ad-d637-4a62-b839-b469c8a69880 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:14.756297 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f22462ad-d637-4a62-b839-b469c8a69880 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:14.757051 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f22462ad-d637-4a62-b839-b469c8a69880 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:14.757476 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f22462ad-d637-4a62-b839-b469c8a69880 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:14.894360 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f22462ad-d637-4a62-b839-b469c8a69880 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:14.902984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f22462ad-d637-4a62-b839-b469c8a69880 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.158343 Jun 06 13:10:14.903597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 121/233] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:14 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:15.920775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-561830df-5b1c-475f-910c-f66dfb49ee71 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:15.924004 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-561830df-5b1c-475f-910c-f66dfb49ee71 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:15.930728 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-561830df-5b1c-475f-910c-f66dfb49ee71 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:15.931185 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-561830df-5b1c-475f-910c-f66dfb49ee71 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:15.932081 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-561830df-5b1c-475f-910c-f66dfb49ee71 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:15.932685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-561830df-5b1c-475f-910c-f66dfb49ee71 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:16.066044 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-561830df-5b1c-475f-910c-f66dfb49ee71 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:16.074246 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-561830df-5b1c-475f-910c-f66dfb49ee71 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.157925 Jun 06 13:10:16.074810 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 113/234] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:15 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:17.054417 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1639364686", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "networks": [{"uuid": "a2d1a624-a5a7-489f-9565-0babb77b566b"}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:17.090990 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-50beafee-1ffb-491d-a2bc-c68d9c8e1248 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:17.091618 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-50beafee-1ffb-491d-a2bc-c68d9c8e1248 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:17.098252 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-50beafee-1ffb-491d-a2bc-c68d9c8e1248 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:17.098698 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-50beafee-1ffb-491d-a2bc-c68d9c8e1248 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:17.099468 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-50beafee-1ffb-491d-a2bc-c68d9c8e1248 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:17.099934 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-50beafee-1ffb-491d-a2bc-c68d9c8e1248 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:17.107192 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] validate_networks() for [('a2d1a624-a5a7-489f-9565-0babb77b566b', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:10:17.312238 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-50beafee-1ffb-491d-a2bc-c68d9c8e1248 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:17.320053 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-50beafee-1ffb-491d-a2bc-c68d9c8e1248 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.233652 Jun 06 13:10:17.320621 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 114/235] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:17 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:17.535785 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:10:17.536206 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:10:17.536677 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:10:17.537138 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:10:17.537545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:10:17.547428 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:17.547951 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:17.548685 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:17.549110 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:17.566818 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Getting quotas for project c6c440914e0f40e49b9fc8ab9f4b6f48. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:10:17.570712 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Getting quotas for user 593bba746dfc40dfbe768b4b9f0c78e3 and project c6c440914e0f40e49b9fc8ab9f4b6f48. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:10:17.581676 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:10:17.583909 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:10:17.758502 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a1ec408d-ade2-4b59-8cd1-33d6a935ec4a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.708013 Jun 06 13:10:17.759576 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 122/236] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:10:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 710 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:10:17.769377 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0c0109de-5b50-4564-ab66-01348226eedf tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:17.770071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0c0109de-5b50-4564-ab66-01348226eedf tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:17.827844 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-0c0109de-5b50-4564-ab66-01348226eedf tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:17.834524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0c0109de-5b50-4564-ab66-01348226eedf tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1219 microversion: 2.1 time: 0.068877 Jun 06 13:10:17.835085 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 115/237] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:17 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1219 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:18.338892 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3a1254a9-cf5c-4148-863e-13d7fdfdf1da tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:18.339352 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3a1254a9-cf5c-4148-863e-13d7fdfdf1da tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:18.354374 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a1254a9-cf5c-4148-863e-13d7fdfdf1da tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:18.354374 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a1254a9-cf5c-4148-863e-13d7fdfdf1da tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:18.354796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a1254a9-cf5c-4148-863e-13d7fdfdf1da tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:18.355118 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a1254a9-cf5c-4148-863e-13d7fdfdf1da tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:18.698599 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3a1254a9-cf5c-4148-863e-13d7fdfdf1da tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:18.707752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3a1254a9-cf5c-4148-863e-13d7fdfdf1da tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.374038 Jun 06 13:10:18.708326 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 123/238] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:18 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:18.852625 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-443cf103-158f-4af1-9665-cfc053a1b73a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:18.853236 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-443cf103-158f-4af1-9665-cfc053a1b73a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:18.860753 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-443cf103-158f-4af1-9665-cfc053a1b73a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:18.861199 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-443cf103-158f-4af1-9665-cfc053a1b73a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:18.861984 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-443cf103-158f-4af1-9665-cfc053a1b73a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:18.862415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-443cf103-158f-4af1-9665-cfc053a1b73a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:18.867053 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:18.930600 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-443cf103-158f-4af1-9665-cfc053a1b73a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:18.938664 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-443cf103-158f-4af1-9665-cfc053a1b73a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1223 microversion: 2.1 time: 0.089993 Jun 06 13:10:18.939263 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 116/239] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:18 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1223 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:19.724212 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4e69d5f4-3454-4f5e-9ebc-dc30e356f628 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:19.724801 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4e69d5f4-3454-4f5e-9ebc-dc30e356f628 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:19.731444 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e69d5f4-3454-4f5e-9ebc-dc30e356f628 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:19.731897 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e69d5f4-3454-4f5e-9ebc-dc30e356f628 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:19.732639 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e69d5f4-3454-4f5e-9ebc-dc30e356f628 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:19.733063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e69d5f4-3454-4f5e-9ebc-dc30e356f628 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:19.864284 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4e69d5f4-3454-4f5e-9ebc-dc30e356f628 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:19.872693 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4e69d5f4-3454-4f5e-9ebc-dc30e356f628 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.152311 Jun 06 13:10:19.873250 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 124/240] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:19 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:19.955636 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-56569e59-eaec-4460-8ced-c4b3c44bf9db tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:19.956303 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-56569e59-eaec-4460-8ced-c4b3c44bf9db tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:19.963029 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-56569e59-eaec-4460-8ced-c4b3c44bf9db tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:19.963471 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-56569e59-eaec-4460-8ced-c4b3c44bf9db tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:19.964957 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-56569e59-eaec-4460-8ced-c4b3c44bf9db tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:19.965392 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-56569e59-eaec-4460-8ced-c4b3c44bf9db tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:20.025518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-56569e59-eaec-4460-8ced-c4b3c44bf9db tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:20.033531 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-56569e59-eaec-4460-8ced-c4b3c44bf9db tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1215 microversion: 2.1 time: 0.082174 Jun 06 13:10:20.034102 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 117/241] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:19 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1215 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:20.889966 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8c1b683a-fc69-4cb5-86f8-aedb04e1dc64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:20.893881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8c1b683a-fc69-4cb5-86f8-aedb04e1dc64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:20.897826 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c1b683a-fc69-4cb5-86f8-aedb04e1dc64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:20.898263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c1b683a-fc69-4cb5-86f8-aedb04e1dc64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:20.899023 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c1b683a-fc69-4cb5-86f8-aedb04e1dc64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:20.899448 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c1b683a-fc69-4cb5-86f8-aedb04e1dc64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:21.026582 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8c1b683a-fc69-4cb5-86f8-aedb04e1dc64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:21.034187 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8c1b683a-fc69-4cb5-86f8-aedb04e1dc64 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.149219 Jun 06 13:10:21.034752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 125/242] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:20 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:21.049987 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2d04eab2-3370-43bc-8d3f-029a8f0bdba6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:21.050523 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2d04eab2-3370-43bc-8d3f-029a8f0bdba6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:21.052797 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=36 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:21.057670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2d04eab2-3370-43bc-8d3f-029a8f0bdba6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:21.058200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2d04eab2-3370-43bc-8d3f-029a8f0bdba6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:21.058992 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2d04eab2-3370-43bc-8d3f-029a8f0bdba6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:21.059422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2d04eab2-3370-43bc-8d3f-029a8f0bdba6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:21.124584 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-2d04eab2-3370-43bc-8d3f-029a8f0bdba6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:21.133664 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2d04eab2-3370-43bc-8d3f-029a8f0bdba6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1215 microversion: 2.1 time: 0.087469 Jun 06 13:10:21.134235 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 118/243] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:21 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1215 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:22.050796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bd4ecd29-2f50-4f7d-a10d-9bc8ff0ea836 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:22.051395 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bd4ecd29-2f50-4f7d-a10d-9bc8ff0ea836 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:22.057429 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bd4ecd29-2f50-4f7d-a10d-9bc8ff0ea836 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:22.058450 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bd4ecd29-2f50-4f7d-a10d-9bc8ff0ea836 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:22.059361 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bd4ecd29-2f50-4f7d-a10d-9bc8ff0ea836 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:22.059826 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bd4ecd29-2f50-4f7d-a10d-9bc8ff0ea836 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:22.153771 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-04305e9b-b6e3-4345-a2ab-af50b840a402 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:22.154376 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-04305e9b-b6e3-4345-a2ab-af50b840a402 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:22.161019 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04305e9b-b6e3-4345-a2ab-af50b840a402 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:22.161460 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04305e9b-b6e3-4345-a2ab-af50b840a402 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:22.162215 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04305e9b-b6e3-4345-a2ab-af50b840a402 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:22.162643 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04305e9b-b6e3-4345-a2ab-af50b840a402 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:22.189724 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bd4ecd29-2f50-4f7d-a10d-9bc8ff0ea836 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:22.197176 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bd4ecd29-2f50-4f7d-a10d-9bc8ff0ea836 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.150163 Jun 06 13:10:22.197750 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 126/244] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:22 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:22.225442 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-04305e9b-b6e3-4345-a2ab-af50b840a402 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:22.233564 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-04305e9b-b6e3-4345-a2ab-af50b840a402 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1215 microversion: 2.1 time: 0.083640 Jun 06 13:10:22.234140 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 119/245] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:22 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1215 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:23.213484 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-59771b39-5362-484e-a202-2add53b4a2de tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:23.214940 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-59771b39-5362-484e-a202-2add53b4a2de tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:23.221439 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-59771b39-5362-484e-a202-2add53b4a2de tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:23.230633 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-59771b39-5362-484e-a202-2add53b4a2de tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:23.230633 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-59771b39-5362-484e-a202-2add53b4a2de tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:23.230633 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-59771b39-5362-484e-a202-2add53b4a2de tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:23.251227 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9aa15995-c068-42d7-8052-819eb77575af tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:23.253539 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9aa15995-c068-42d7-8052-819eb77575af tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:23.263256 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9aa15995-c068-42d7-8052-819eb77575af tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:23.263732 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9aa15995-c068-42d7-8052-819eb77575af tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:23.264893 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9aa15995-c068-42d7-8052-819eb77575af tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:23.265386 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9aa15995-c068-42d7-8052-819eb77575af tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:23.367130 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9aa15995-c068-42d7-8052-819eb77575af tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:23.377401 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9aa15995-c068-42d7-8052-819eb77575af tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1289 microversion: 2.1 time: 0.130481 Jun 06 13:10:23.386500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 120/246] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:23 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1289 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:23.398216 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-59771b39-5362-484e-a202-2add53b4a2de tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:23.416055 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-59771b39-5362-484e-a202-2add53b4a2de tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.206328 Jun 06 13:10:23.416651 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 127/247] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:23 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:24.394201 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-67a2defe-a663-4e3b-ac25-847eef1eb808 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:24.394809 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-67a2defe-a663-4e3b-ac25-847eef1eb808 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:24.402023 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67a2defe-a663-4e3b-ac25-847eef1eb808 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:24.402748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67a2defe-a663-4e3b-ac25-847eef1eb808 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:24.403711 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67a2defe-a663-4e3b-ac25-847eef1eb808 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:24.411669 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67a2defe-a663-4e3b-ac25-847eef1eb808 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:24.439455 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-82cf22d5-556b-47d4-9111-c3a6424c7778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:24.446182 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-82cf22d5-556b-47d4-9111-c3a6424c7778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:24.460601 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82cf22d5-556b-47d4-9111-c3a6424c7778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:24.461845 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82cf22d5-556b-47d4-9111-c3a6424c7778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:24.466291 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82cf22d5-556b-47d4-9111-c3a6424c7778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:24.477569 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82cf22d5-556b-47d4-9111-c3a6424c7778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:24.696378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-67a2defe-a663-4e3b-ac25-847eef1eb808 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:24.710529 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-67a2defe-a663-4e3b-ac25-847eef1eb808 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1319 microversion: 2.1 time: 0.319946 Jun 06 13:10:24.722320 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 121/248] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:24 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1319 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:24.783686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-82cf22d5-556b-47d4-9111-c3a6424c7778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:24.800283 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-82cf22d5-556b-47d4-9111-c3a6424c7778 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.361747 Jun 06 13:10:24.800283 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 128/249] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:24 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:25.023701 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-7ee0554e-410e-4096-aeff-4d2af32dc18c req-0334b311-cdb5-4905-af5f-63516b73b848 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "b4130f6a-248b-4a11-8acf-926e747f6a9e", "tag": "e969dde9-8fb6-4882-845d-107e055837eb"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:25.033082 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-7ee0554e-410e-4096-aeff-4d2af32dc18c req-0334b311-cdb5-4905-af5f-63516b73b848 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:25.033521 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-7ee0554e-410e-4096-aeff-4d2af32dc18c req-0334b311-cdb5-4905-af5f-63516b73b848 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:25.045186 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-7ee0554e-410e-4096-aeff-4d2af32dc18c req-0334b311-cdb5-4905-af5f-63516b73b848 service nova] Creating event network-changed:e969dde9-8fb6-4882-845d-107e055837eb for instance b4130f6a-248b-4a11-8acf-926e747f6a9e on hv-cinder-75510 Jun 06 13:10:25.050629 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-7ee0554e-410e-4096-aeff-4d2af32dc18c req-0334b311-cdb5-4905-af5f-63516b73b848 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031724 Jun 06 13:10:25.051590 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 122/250] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:10:25 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:10:25.728664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ee7a3e0b-4919-4134-a9a5-48da5fa9c095 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:25.729356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ee7a3e0b-4919-4134-a9a5-48da5fa9c095 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:25.735923 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ee7a3e0b-4919-4134-a9a5-48da5fa9c095 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:25.737204 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ee7a3e0b-4919-4134-a9a5-48da5fa9c095 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:25.737204 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ee7a3e0b-4919-4134-a9a5-48da5fa9c095 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:25.737622 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ee7a3e0b-4919-4134-a9a5-48da5fa9c095 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:25.809684 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c32e4b78-9631-4386-81f7-52429f571e8d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:25.810442 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c32e4b78-9631-4386-81f7-52429f571e8d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:25.816859 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c32e4b78-9631-4386-81f7-52429f571e8d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:25.817309 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c32e4b78-9631-4386-81f7-52429f571e8d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:25.818246 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c32e4b78-9631-4386-81f7-52429f571e8d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:25.818544 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c32e4b78-9631-4386-81f7-52429f571e8d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:25.900840 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ee7a3e0b-4919-4134-a9a5-48da5fa9c095 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:25.909778 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ee7a3e0b-4919-4134-a9a5-48da5fa9c095 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1319 microversion: 2.1 time: 0.185086 Jun 06 13:10:25.919402 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 129/251] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:25 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1319 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:25.974832 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c32e4b78-9631-4386-81f7-52429f571e8d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:25.982379 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c32e4b78-9631-4386-81f7-52429f571e8d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.177777 Jun 06 13:10:25.982940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 123/252] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:25 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:26.926076 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-075d4922-01ee-40d3-a30a-e5dbecbab83a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:26.926675 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-075d4922-01ee-40d3-a30a-e5dbecbab83a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:26.932757 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-075d4922-01ee-40d3-a30a-e5dbecbab83a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:26.933719 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-075d4922-01ee-40d3-a30a-e5dbecbab83a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:26.934529 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-075d4922-01ee-40d3-a30a-e5dbecbab83a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:26.934959 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-075d4922-01ee-40d3-a30a-e5dbecbab83a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:26.999294 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d659746d-a8b6-472b-acc5-35b5423f20c4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:26.999974 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d659746d-a8b6-472b-acc5-35b5423f20c4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:27.006759 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d659746d-a8b6-472b-acc5-35b5423f20c4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:27.008346 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d659746d-a8b6-472b-acc5-35b5423f20c4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:27.009369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d659746d-a8b6-472b-acc5-35b5423f20c4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:27.010113 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d659746d-a8b6-472b-acc5-35b5423f20c4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:27.105993 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-075d4922-01ee-40d3-a30a-e5dbecbab83a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:27.114990 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-075d4922-01ee-40d3-a30a-e5dbecbab83a tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1319 microversion: 2.1 time: 0.192697 Jun 06 13:10:27.115604 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 130/253] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:26 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1319 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:27.175642 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d659746d-a8b6-472b-acc5-35b5423f20c4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:27.183176 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d659746d-a8b6-472b-acc5-35b5423f20c4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.188831 Jun 06 13:10:27.184365 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 124/254] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:26 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:28.132279 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c2d4d4f5-a4bd-4e3a-acfc-59daec475867 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:28.132885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c2d4d4f5-a4bd-4e3a-acfc-59daec475867 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:28.135853 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:28.137206 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:28.141206 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c2d4d4f5-a4bd-4e3a-acfc-59daec475867 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:28.141973 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c2d4d4f5-a4bd-4e3a-acfc-59daec475867 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:28.142746 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c2d4d4f5-a4bd-4e3a-acfc-59daec475867 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:28.143180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c2d4d4f5-a4bd-4e3a-acfc-59daec475867 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:28.201359 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c9022e33-94bd-4508-a282-efd744249589 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:28.202229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c9022e33-94bd-4508-a282-efd744249589 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:28.210736 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:28.216647 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c9022e33-94bd-4508-a282-efd744249589 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:28.217393 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c9022e33-94bd-4508-a282-efd744249589 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:28.221664 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c9022e33-94bd-4508-a282-efd744249589 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:28.222209 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c9022e33-94bd-4508-a282-efd744249589 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:28.340766 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c2d4d4f5-a4bd-4e3a-acfc-59daec475867 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:28.357974 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c2d4d4f5-a4bd-4e3a-acfc-59daec475867 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1319 microversion: 2.1 time: 0.229445 Jun 06 13:10:28.358798 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 131/255] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:28 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1319 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:28.396092 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c9022e33-94bd-4508-a282-efd744249589 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:28.404704 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c9022e33-94bd-4508-a282-efd744249589 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.207844 Jun 06 13:10:28.405275 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 125/256] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:28 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:29.375145 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2ab452dd-e3ea-4c7f-a0b7-769bf0fd188d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:29.376507 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2ab452dd-e3ea-4c7f-a0b7-769bf0fd188d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:29.383898 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2ab452dd-e3ea-4c7f-a0b7-769bf0fd188d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:29.384439 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2ab452dd-e3ea-4c7f-a0b7-769bf0fd188d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:29.385113 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2ab452dd-e3ea-4c7f-a0b7-769bf0fd188d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:29.385545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2ab452dd-e3ea-4c7f-a0b7-769bf0fd188d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:29.422622 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-51a50b3c-ee7a-4ed8-8e7d-9f661e027e26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:29.423226 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-51a50b3c-ee7a-4ed8-8e7d-9f661e027e26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:29.430214 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-51a50b3c-ee7a-4ed8-8e7d-9f661e027e26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:29.431586 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-51a50b3c-ee7a-4ed8-8e7d-9f661e027e26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:29.431586 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-51a50b3c-ee7a-4ed8-8e7d-9f661e027e26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:29.431942 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-51a50b3c-ee7a-4ed8-8e7d-9f661e027e26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:29.579641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2ab452dd-e3ea-4c7f-a0b7-769bf0fd188d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:29.587645 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2ab452dd-e3ea-4c7f-a0b7-769bf0fd188d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1319 microversion: 2.1 time: 0.216564 Jun 06 13:10:29.595236 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 132/257] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:29 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1319 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:29.611015 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-51a50b3c-ee7a-4ed8-8e7d-9f661e027e26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:29.618775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-51a50b3c-ee7a-4ed8-8e7d-9f661e027e26 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.200848 Jun 06 13:10:29.619343 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 126/258] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:29 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:30.606084 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e93e3064-99d3-4eb0-81a9-b37dfbac9e7b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:30.606770 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e93e3064-99d3-4eb0-81a9-b37dfbac9e7b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:30.613668 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e93e3064-99d3-4eb0-81a9-b37dfbac9e7b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:30.614071 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e93e3064-99d3-4eb0-81a9-b37dfbac9e7b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:30.615487 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e93e3064-99d3-4eb0-81a9-b37dfbac9e7b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:30.616131 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e93e3064-99d3-4eb0-81a9-b37dfbac9e7b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:30.636088 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bfe8b607-daac-4b31-96d6-5ab52fb01cdf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:30.636908 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-bfe8b607-daac-4b31-96d6-5ab52fb01cdf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:30.643968 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bfe8b607-daac-4b31-96d6-5ab52fb01cdf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:30.648012 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bfe8b607-daac-4b31-96d6-5ab52fb01cdf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:30.650117 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bfe8b607-daac-4b31-96d6-5ab52fb01cdf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:30.650566 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bfe8b607-daac-4b31-96d6-5ab52fb01cdf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:30.656037 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:30.845603 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e93e3064-99d3-4eb0-81a9-b37dfbac9e7b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:30.849797 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-bfe8b607-daac-4b31-96d6-5ab52fb01cdf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:30.854507 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e93e3064-99d3-4eb0-81a9-b37dfbac9e7b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1319 microversion: 2.1 time: 0.252822 Jun 06 13:10:30.855406 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 133/259] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:30 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1319 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:30.867293 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-bfe8b607-daac-4b31-96d6-5ab52fb01cdf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.234833 Jun 06 13:10:30.868215 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 127/260] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:30 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 236 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:31.872634 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-073edfa9-f633-45bc-9b39-bd55cc4351be tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:31.873197 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-073edfa9-f633-45bc-9b39-bd55cc4351be tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:31.879346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-073edfa9-f633-45bc-9b39-bd55cc4351be tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:31.879819 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-073edfa9-f633-45bc-9b39-bd55cc4351be tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:31.880572 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-073edfa9-f633-45bc-9b39-bd55cc4351be tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:31.880998 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-073edfa9-f633-45bc-9b39-bd55cc4351be tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:31.883785 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3693c4b9-b62c-4a65-b9b1-1d9f7570e33e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:31.884460 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3693c4b9-b62c-4a65-b9b1-1d9f7570e33e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:31.891519 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3693c4b9-b62c-4a65-b9b1-1d9f7570e33e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:31.891999 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3693c4b9-b62c-4a65-b9b1-1d9f7570e33e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:31.892773 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3693c4b9-b62c-4a65-b9b1-1d9f7570e33e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:31.893211 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3693c4b9-b62c-4a65-b9b1-1d9f7570e33e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:32.122738 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-073edfa9-f633-45bc-9b39-bd55cc4351be tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:32.125937 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3693c4b9-b62c-4a65-b9b1-1d9f7570e33e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:32.131063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-073edfa9-f633-45bc-9b39-bd55cc4351be tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1319 microversion: 2.1 time: 0.262837 Jun 06 13:10:32.131885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 134/261] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:31 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1319 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:32.134738 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3693c4b9-b62c-4a65-b9b1-1d9f7570e33e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.254826 Jun 06 13:10:32.143678 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 128/262] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:31 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:32.303136 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f5090f40-8eec-46af-9a65-70b17ce9ca84 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:32.303659 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f5090f40-8eec-46af-9a65-70b17ce9ca84 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:32.313162 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5090f40-8eec-46af-9a65-70b17ce9ca84 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:32.313801 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5090f40-8eec-46af-9a65-70b17ce9ca84 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:32.314874 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5090f40-8eec-46af-9a65-70b17ce9ca84 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:32.315318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5090f40-8eec-46af-9a65-70b17ce9ca84 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:32.340988 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f5090f40-8eec-46af-9a65-70b17ce9ca84 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/ips" status: 200 len: 146 microversion: 2.1 time: 0.041709 Jun 06 13:10:32.341551 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 135/263] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 13:10:32 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/ips => generated 146 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:10:33.149421 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d84ebba2-7455-4676-bc29-69e35364f6e4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:33.150146 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d84ebba2-7455-4676-bc29-69e35364f6e4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:33.151834 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d0f971d7-2ff1-4cc1-a348-cf3693171ed4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:33.152441 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d0f971d7-2ff1-4cc1-a348-cf3693171ed4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:33.157440 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d84ebba2-7455-4676-bc29-69e35364f6e4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:33.157911 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d84ebba2-7455-4676-bc29-69e35364f6e4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:33.158690 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d84ebba2-7455-4676-bc29-69e35364f6e4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:33.159125 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d84ebba2-7455-4676-bc29-69e35364f6e4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:33.159385 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0f971d7-2ff1-4cc1-a348-cf3693171ed4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:33.159870 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0f971d7-2ff1-4cc1-a348-cf3693171ed4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:33.160631 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0f971d7-2ff1-4cc1-a348-cf3693171ed4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:33.161066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0f971d7-2ff1-4cc1-a348-cf3693171ed4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:33.365078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d84ebba2-7455-4676-bc29-69e35364f6e4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:33.374229 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0f971d7-2ff1-4cc1-a348-cf3693171ed4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:33.382947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d84ebba2-7455-4676-bc29-69e35364f6e4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1319 microversion: 2.1 time: 0.237514 Jun 06 13:10:33.385763 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 129/264] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:33 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1319 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:33.387666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d0f971d7-2ff1-4cc1-a348-cf3693171ed4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.239564 Jun 06 13:10:33.392612 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 136/265] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:33 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:33.395717 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4e3f79ea-d084-4f64-b95d-c4eb614db180 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:33.398351 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-4e3f79ea-d084-4f64-b95d-c4eb614db180 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:33.405397 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4e3f79ea-d084-4f64-b95d-c4eb614db180 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:33.405845 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4e3f79ea-d084-4f64-b95d-c4eb614db180 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:33.407074 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4e3f79ea-d084-4f64-b95d-c4eb614db180 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:33.407565 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4e3f79ea-d084-4f64-b95d-c4eb614db180 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:33.431282 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-4e3f79ea-d084-4f64-b95d-c4eb614db180 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/ips" status: 200 len: 151 microversion: 2.20 time: 0.044141 Jun 06 13:10:33.431877 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 130/266] 10.222.0.13 () {60 vars in 1288 bytes} [Mon Jun 6 13:10:33 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/ips => generated 151 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:10:33.592260 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-70954bd5-d200-486e-94ba-c45a65054e56 req-a27d1e0f-2ca2-487b-8106-7d28fcd44134 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4130f6a-248b-4a11-8acf-926e747f6a9e", "name": "network-vif-plugged", "status": "completed", "tag": "e969dde9-8fb6-4882-845d-107e055837eb"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:33.601618 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-70954bd5-d200-486e-94ba-c45a65054e56 req-a27d1e0f-2ca2-487b-8106-7d28fcd44134 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:33.602088 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-70954bd5-d200-486e-94ba-c45a65054e56 req-a27d1e0f-2ca2-487b-8106-7d28fcd44134 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:33.614278 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-70954bd5-d200-486e-94ba-c45a65054e56 req-a27d1e0f-2ca2-487b-8106-7d28fcd44134 service nova] Creating event network-vif-plugged:e969dde9-8fb6-4882-845d-107e055837eb for instance b4130f6a-248b-4a11-8acf-926e747f6a9e on hv-cinder-75510 Jun 06 13:10:33.619245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-70954bd5-d200-486e-94ba-c45a65054e56 req-a27d1e0f-2ca2-487b-8106-7d28fcd44134 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.037136 Jun 06 13:10:33.620040 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 137/267] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:10:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:10:33.913587 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2159aa60-2baf-464e-af0c-a503d6590ee0 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:33.914181 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2159aa60-2baf-464e-af0c-a503d6590ee0 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:33.926301 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2159aa60-2baf-464e-af0c-a503d6590ee0 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:33.928672 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2159aa60-2baf-464e-af0c-a503d6590ee0 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:33.939458 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2159aa60-2baf-464e-af0c-a503d6590ee0 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:33.940102 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2159aa60-2baf-464e-af0c-a503d6590ee0 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:33.964340 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2159aa60-2baf-464e-af0c-a503d6590ee0 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/ips" status: 200 len: 151 microversion: 2.1 time: 0.056882 Jun 06 13:10:33.964956 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 131/268] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 13:10:33 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/ips => generated 151 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:10:34.407362 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1334f294-0b12-4f2b-b642-90ab04ef9d0e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:34.408084 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1334f294-0b12-4f2b-b642-90ab04ef9d0e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:34.409720 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-70601f64-a01b-4173-a4b7-1e4dee4b4f8e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:34.410975 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-70601f64-a01b-4173-a4b7-1e4dee4b4f8e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:34.414705 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1334f294-0b12-4f2b-b642-90ab04ef9d0e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:34.415174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1334f294-0b12-4f2b-b642-90ab04ef9d0e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:34.415958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1334f294-0b12-4f2b-b642-90ab04ef9d0e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:34.416383 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1334f294-0b12-4f2b-b642-90ab04ef9d0e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:34.417746 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-70601f64-a01b-4173-a4b7-1e4dee4b4f8e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:34.418200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-70601f64-a01b-4173-a4b7-1e4dee4b4f8e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:34.419936 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-70601f64-a01b-4173-a4b7-1e4dee4b4f8e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:34.420385 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-70601f64-a01b-4173-a4b7-1e4dee4b4f8e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:34.631654 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1334f294-0b12-4f2b-b642-90ab04ef9d0e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:34.635447 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-70601f64-a01b-4173-a4b7-1e4dee4b4f8e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:34.639287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1334f294-0b12-4f2b-b642-90ab04ef9d0e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1319 microversion: 2.1 time: 0.238729 Jun 06 13:10:34.639882 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 138/269] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:34 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:34.644381 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-70601f64-a01b-4173-a4b7-1e4dee4b4f8e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.239541 Jun 06 13:10:34.645523 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 132/270] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:34 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:35.657762 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-293b4da1-0432-4ebf-9e03-3cc866f92dbe tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:35.658373 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-293b4da1-0432-4ebf-9e03-3cc866f92dbe tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:35.661948 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-674a514d-44f9-44b6-b8f8-7678743de695 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:35.662547 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-674a514d-44f9-44b6-b8f8-7678743de695 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:35.664542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-293b4da1-0432-4ebf-9e03-3cc866f92dbe tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:35.665013 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-293b4da1-0432-4ebf-9e03-3cc866f92dbe tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:35.665772 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-293b4da1-0432-4ebf-9e03-3cc866f92dbe tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:35.666205 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-293b4da1-0432-4ebf-9e03-3cc866f92dbe tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:35.668848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-674a514d-44f9-44b6-b8f8-7678743de695 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:35.669289 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-674a514d-44f9-44b6-b8f8-7678743de695 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:35.670044 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-674a514d-44f9-44b6-b8f8-7678743de695 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:35.670483 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-674a514d-44f9-44b6-b8f8-7678743de695 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:35.878350 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-293b4da1-0432-4ebf-9e03-3cc866f92dbe tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:35.882491 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-674a514d-44f9-44b6-b8f8-7678743de695 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:35.893392 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-293b4da1-0432-4ebf-9e03-3cc866f92dbe tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1319 microversion: 2.1 time: 0.236909 Jun 06 13:10:35.893392 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 139/271] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:35 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1319 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:35.897531 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-674a514d-44f9-44b6-b8f8-7678743de695 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.239337 Jun 06 13:10:35.898146 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 133/272] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:35 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:35.995042 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-550ed4f9-daa7-43f4-b026-47053f2d6449 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5518ec4-1cc0-4e33-8a7a-97d829894e35"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:35.996314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-550ed4f9-daa7-43f4-b026-47053f2d6449 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:36.003820 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-550ed4f9-daa7-43f4-b026-47053f2d6449 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:36.004274 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-550ed4f9-daa7-43f4-b026-47053f2d6449 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:36.005084 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-550ed4f9-daa7-43f4-b026-47053f2d6449 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:36.005672 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-550ed4f9-daa7-43f4-b026-47053f2d6449 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:36.115229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-8acf8aa7-c808-490c-8dc9-e13f801a77e1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "0f0b57a7-dc9b-49b9-94ce-e47b85f5a72c"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:36.116322 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8acf8aa7-c808-490c-8dc9-e13f801a77e1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:36.125271 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8acf8aa7-c808-490c-8dc9-e13f801a77e1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:36.126293 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8acf8aa7-c808-490c-8dc9-e13f801a77e1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:36.131331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8acf8aa7-c808-490c-8dc9-e13f801a77e1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:36.131331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8acf8aa7-c808-490c-8dc9-e13f801a77e1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:36.131331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=100 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:37.736701 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-550ed4f9-daa7-43f4-b026-47053f2d6449 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "POST /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.745700 Jun 06 13:10:37.737469 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 140/273] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:10:35 2022] POST /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments => generated 194 bytes in 1747 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:10:37.742572 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1b109a14-1af6-4a42-8340-cd9553a81cb5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:37.743178 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1b109a14-1af6-4a42-8340-cd9553a81cb5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:37.750036 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1b109a14-1af6-4a42-8340-cd9553a81cb5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:37.750496 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1b109a14-1af6-4a42-8340-cd9553a81cb5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:37.751265 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1b109a14-1af6-4a42-8340-cd9553a81cb5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:37.751731 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1b109a14-1af6-4a42-8340-cd9553a81cb5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:37.775451 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-1b109a14-1af6-4a42-8340-cd9553a81cb5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lazy-loading 'flavor' on Instance uuid 8fc5ce11-0a01-44fd-9be7-c095a8254551 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:10:37.822768 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-8acf8aa7-c808-490c-8dc9-e13f801a77e1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "POST /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.711144 Jun 06 13:10:37.823289 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 134/274] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:10:36 2022] POST /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/os-volume_attachments => generated 194 bytes in 1713 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:10:37.833347 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f53b0024-0993-4418-a71d-38f90feb239b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:37.834287 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f53b0024-0993-4418-a71d-38f90feb239b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:37.841083 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f53b0024-0993-4418-a71d-38f90feb239b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:37.841885 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f53b0024-0993-4418-a71d-38f90feb239b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:37.842667 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f53b0024-0993-4418-a71d-38f90feb239b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:37.843108 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f53b0024-0993-4418-a71d-38f90feb239b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:38.007876 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f53b0024-0993-4418-a71d-38f90feb239b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:38.016541 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f53b0024-0993-4418-a71d-38f90feb239b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1509 microversion: 2.1 time: 0.190869 Jun 06 13:10:38.020445 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 135/275] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:37 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1509 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:38.024319 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-8320aa9d-9b47-4132-bb35-7a8eb820c7ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:38.024972 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8320aa9d-9b47-4132-bb35-7a8eb820c7ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:38.034194 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8320aa9d-9b47-4132-bb35-7a8eb820c7ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:38.034571 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8320aa9d-9b47-4132-bb35-7a8eb820c7ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:38.035341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8320aa9d-9b47-4132-bb35-7a8eb820c7ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:38.035810 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8320aa9d-9b47-4132-bb35-7a8eb820c7ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:38.184530 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-8320aa9d-9b47-4132-bb35-7a8eb820c7ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:38.193142 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-8320aa9d-9b47-4132-bb35-7a8eb820c7ae tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1502 microversion: 2.1 time: 0.174766 Jun 06 13:10:38.193758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 136/276] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:38 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1502 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:38.212230 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c1e0d67c-5b08-47d0-8370-4e7c8c9f6c56 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b2b0b36d-a086-4a2a-8f3b-6ee723026e8e"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:38.213354 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c1e0d67c-5b08-47d0-8370-4e7c8c9f6c56 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:38.219748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1e0d67c-5b08-47d0-8370-4e7c8c9f6c56 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:38.220192 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1e0d67c-5b08-47d0-8370-4e7c8c9f6c56 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:38.220942 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1e0d67c-5b08-47d0-8370-4e7c8c9f6c56 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:38.221370 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1e0d67c-5b08-47d0-8370-4e7c8c9f6c56 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:38.244096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-c1e0d67c-5b08-47d0-8370-4e7c8c9f6c56 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] HTTP exception thrown: Cannot 'attach_volume' instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 while it is in vm_state rescued Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c1e0d67c-5b08-47d0-8370-4e7c8c9f6c56 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Request method failure captured: Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: POST /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108/os-volume_attachments HTTP/1.1 Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 74 Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxZJTqH2tvjPaOfLf-GjKi9DdpfIw9vV-Dj8yIkT7Rz3rbj4seroxoGaC5amp93DC0XDdTji9E52xtlJmjDKJNS6ZcOTzI7g0ybI49K_1pbrztUd9_A_fsQh8uT7czdbHN5L1S_Ro5cLnbwPwf9s-JIk1_jyoTpeaVfStvrpu_2Lhk Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: d2263cfc378b4967ab4d2817991874f5 Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:10:38.245904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:10:38.247745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d2263cfc378b4967ab4d2817991874f5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d2263cfc378b4967ab4d2817991874f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d2263cfc378b4967ab4d2817991874f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d2263cfc378b4967ab4d2817991874f5"}]}] Jun 06 13:10:38.247745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:10:38.247745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: d2263cfc378b4967ab4d2817991874f5 Jun 06 13:10:38.247745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:10:38.247745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-ServerRescueNegativeTestJSON-1216849386-project Jun 06 13:10:38.247745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:10:38.247745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:10:38.247745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: e8410e3632ec4908824d336fff667da5 Jun 06 13:10:38.247745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1216849386-project Jun 06 13:10:38.247745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Jun 06 13:10:38.247745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {"volumeAttachment": {"volumeId": "b2b0b36d-a086-4a2a-8f3b-6ee723026e8e"}} Jun 06 13:10:38.247745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Cannot 'attach_volume' instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 while it is in vm_state rescued Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'server_id': '5c50c488-a0ae-4331-9dfe-5fb0b7ab5108', 'body': {'volumeAttachment': {'volumeId': 'b2b0b36d-a086-4a2a-8f3b-6ee723026e8e'}}} Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 in vm_state rescued. Cannot attach_volume while the instance is in this state. Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:10:38.248449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 while it is in vm_state rescued Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:10:38.249904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:10:38.251243 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:10:38.251243 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:10:38.251243 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 while it is in vm_state rescued Jun 06 13:10:38.251243 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:10:38.251243 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c1e0d67c-5b08-47d0-8370-4e7c8c9f6c56 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Returning 409 to user: Cannot 'attach_volume' instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 while it is in vm_state rescued {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:10:38.251243 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c1e0d67c-5b08-47d0-8370-4e7c8c9f6c56 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "POST /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.039169 Jun 06 13:10:38.251243 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 137/277] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:10:38 2022] POST /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108/os-volume_attachments => generated 152 bytes in 41 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Jun 06 13:10:38.257546 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-870293a5-11cf-4189-9c2b-c64e233b07a4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:38.258075 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-870293a5-11cf-4189-9c2b-c64e233b07a4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:38.264735 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-870293a5-11cf-4189-9c2b-c64e233b07a4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:38.265170 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-870293a5-11cf-4189-9c2b-c64e233b07a4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:38.265930 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-870293a5-11cf-4189-9c2b-c64e233b07a4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:38.266357 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-870293a5-11cf-4189-9c2b-c64e233b07a4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:38.451629 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-870293a5-11cf-4189-9c2b-c64e233b07a4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "POST /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108/action" status: 202 len: 0 microversion: 2.1 time: 0.197418 Jun 06 13:10:38.453568 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 138/278] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:10:38 2022] POST /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108/action => generated 0 bytes in 200 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:10:38.460613 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d50706cc-cbc7-4437-9085-537fafa32517 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:38.461305 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d50706cc-cbc7-4437-9085-537fafa32517 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:38.467817 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d50706cc-cbc7-4437-9085-537fafa32517 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:38.468267 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d50706cc-cbc7-4437-9085-537fafa32517 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:38.469040 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d50706cc-cbc7-4437-9085-537fafa32517 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:38.469472 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d50706cc-cbc7-4437-9085-537fafa32517 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:38.607872 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d50706cc-cbc7-4437-9085-537fafa32517 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:38.616553 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d50706cc-cbc7-4437-9085-537fafa32517 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1510 microversion: 2.1 time: 0.159714 Jun 06 13:10:38.632135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 139/279] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:38 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1510 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:39.638183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-40f79866-dbf3-49fe-a317-edd7cc043c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:39.638843 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-40f79866-dbf3-49fe-a317-edd7cc043c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:39.645705 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-40f79866-dbf3-49fe-a317-edd7cc043c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:39.646077 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-40f79866-dbf3-49fe-a317-edd7cc043c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:39.646827 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-40f79866-dbf3-49fe-a317-edd7cc043c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:39.647252 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-40f79866-dbf3-49fe-a317-edd7cc043c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:39.785143 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-40f79866-dbf3-49fe-a317-edd7cc043c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:39.792837 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-40f79866-dbf3-49fe-a317-edd7cc043c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1510 microversion: 2.1 time: 0.158441 Jun 06 13:10:39.793395 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 140/280] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:39 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1510 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:40.810412 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cb02a90b-303e-405d-96f0-785fb0474683 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:40.811091 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-cb02a90b-303e-405d-96f0-785fb0474683 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:40.818566 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cb02a90b-303e-405d-96f0-785fb0474683 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:40.819001 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cb02a90b-303e-405d-96f0-785fb0474683 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:40.819801 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cb02a90b-303e-405d-96f0-785fb0474683 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:40.820241 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cb02a90b-303e-405d-96f0-785fb0474683 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:40.972456 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cb02a90b-303e-405d-96f0-785fb0474683 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:40.980013 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cb02a90b-303e-405d-96f0-785fb0474683 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1510 microversion: 2.1 time: 0.173476 Jun 06 13:10:40.980809 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 141/281] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:40 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1510 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:41.998532 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-22eae63b-9160-4119-852e-58f885d0c45e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:41.999296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-22eae63b-9160-4119-852e-58f885d0c45e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:42.005980 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-22eae63b-9160-4119-852e-58f885d0c45e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:42.006496 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-22eae63b-9160-4119-852e-58f885d0c45e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:42.007331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-22eae63b-9160-4119-852e-58f885d0c45e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:42.007903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-22eae63b-9160-4119-852e-58f885d0c45e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:42.166355 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-22eae63b-9160-4119-852e-58f885d0c45e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:42.174908 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-22eae63b-9160-4119-852e-58f885d0c45e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1516 microversion: 2.1 time: 0.180823 Jun 06 13:10:42.175469 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 142/282] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:41 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1516 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:43.882527 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c5fd7837-eadb-4446-9827-19624bcfe834 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Action: 'create', calling method: .version_select at 0x7f0efc1bbee0>, body: {"keypair": {"name": "tempest-keypair-807841164", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFtUOJA2eKwxSAt2LNAnCpWgNGDVz+Mc/jKe3EMyFJRnCl/QBu8QYmy6tSYeUfD03n40Uf6p1c/p8WfoUOpaB+QDgQbhbuEIjMVwL2Ms8XhFAO8J38QYch0doA9hRfpOYw=="}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:43.898434 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-c5fd7837-eadb-4446-9827-19624bcfe834 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Getting quotas for project d2263cfc378b4967ab4d2817991874f5. Resources: {'key_pairs'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:10:43.902354 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-c5fd7837-eadb-4446-9827-19624bcfe834 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Getting quotas for user e8410e3632ec4908824d336fff667da5 and project d2263cfc378b4967ab4d2817991874f5. Resources: {'key_pairs'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:10:43.981447 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c5fd7837-eadb-4446-9827-19624bcfe834 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102794 Jun 06 13:10:43.982043 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 143/283] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 13:10:43 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:10:45.664930 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1b109a14-1af6-4a42-8340-cd9553a81cb5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "POST /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/action" status: 202 len: 0 microversion: 2.20 time: 7.925994 Jun 06 13:10:45.667623 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 141/284] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jun 6 13:10:37 2022] POST /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/action => generated 0 bytes in 7928 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:10:45.674943 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-7b23c227-ff84-4ed6-8e4e-ff2481268fe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:45.675739 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-7b23c227-ff84-4ed6-8e4e-ff2481268fe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:45.682869 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b23c227-ff84-4ed6-8e4e-ff2481268fe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:45.683012 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b23c227-ff84-4ed6-8e4e-ff2481268fe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:45.683830 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b23c227-ff84-4ed6-8e4e-ff2481268fe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:45.684287 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b23c227-ff84-4ed6-8e4e-ff2481268fe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:45.820570 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-7b23c227-ff84-4ed6-8e4e-ff2481268fe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:45.828655 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-7b23c227-ff84-4ed6-8e4e-ff2481268fe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:45.830078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-7b23c227-ff84-4ed6-8e4e-ff2481268fe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:45.831481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-7b23c227-ff84-4ed6-8e4e-ff2481268fe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.161345 Jun 06 13:10:45.832368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 144/285] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:10:45 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:10:46.534356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1569984507", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "057a1f64-b5b0-43c4-8588-382931d7cc3c"}], "security_groups": [{"name": "tempest-securitygroup--540358125"}], "key_name": "tempest-keypair-807841164", "user_data": "}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:46.540854 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=53,nova_api:INSERT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:46.652130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] validate_networks() for [('057a1f64-b5b0-43c4-8588-382931d7cc3c', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:10:46.850170 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bfdd4747-fc81-4496-8697-cd86f091dfb6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:46.850777 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-bfdd4747-fc81-4496-8697-cd86f091dfb6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:46.857206 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bfdd4747-fc81-4496-8697-cd86f091dfb6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:46.857684 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bfdd4747-fc81-4496-8697-cd86f091dfb6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:46.858441 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bfdd4747-fc81-4496-8697-cd86f091dfb6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:46.858867 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bfdd4747-fc81-4496-8697-cd86f091dfb6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:47.056569 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-bfdd4747-fc81-4496-8697-cd86f091dfb6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:47.065293 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-bfdd4747-fc81-4496-8697-cd86f091dfb6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:47.066865 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-bfdd4747-fc81-4496-8697-cd86f091dfb6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:47.068146 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-bfdd4747-fc81-4496-8697-cd86f091dfb6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.221950 Jun 06 13:10:47.068924 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 145/286] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:10:46 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:10:47.092950 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:10:47.093430 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:10:47.094474 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:10:47.094997 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:10:47.095407 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:10:47.104429 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:47.104904 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:47.105690 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:47.106117 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:47.124285 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Getting quotas for project d2263cfc378b4967ab4d2817991874f5. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:10:47.128493 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Getting quotas for user e8410e3632ec4908824d336fff667da5 and project d2263cfc378b4967ab4d2817991874f5. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:10:47.139471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:10:47.142092 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:10:47.251794 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d7849a1f-6ede-4fce-8bee-0cc219254a61 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.722513 Jun 06 13:10:47.252428 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 142/287] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:10:46 2022] POST /compute/v2.1/servers => generated 408 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:10:47.262155 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6f3ca3e2-8e1b-4bda-abb0-767c91065a62 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:47.262838 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6f3ca3e2-8e1b-4bda-abb0-767c91065a62 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:47.320924 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6f3ca3e2-8e1b-4bda-abb0-767c91065a62 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:47.329805 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6f3ca3e2-8e1b-4bda-abb0-767c91065a62 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1245 microversion: 2.1 time: 0.071385 Jun 06 13:10:47.330833 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 146/288] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:47 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1245 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:48.087166 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-27a3f6f5-bf5a-457f-b6d6-afa84c228637 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:48.087705 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-27a3f6f5-bf5a-457f-b6d6-afa84c228637 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:48.095369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27a3f6f5-bf5a-457f-b6d6-afa84c228637 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:48.095962 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27a3f6f5-bf5a-457f-b6d6-afa84c228637 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:48.096560 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27a3f6f5-bf5a-457f-b6d6-afa84c228637 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:48.096984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27a3f6f5-bf5a-457f-b6d6-afa84c228637 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:48.236314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-27a3f6f5-bf5a-457f-b6d6-afa84c228637 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:48.245012 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-27a3f6f5-bf5a-457f-b6d6-afa84c228637 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:48.246599 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-27a3f6f5-bf5a-457f-b6d6-afa84c228637 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:48.247830 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-27a3f6f5-bf5a-457f-b6d6-afa84c228637 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.165210 Jun 06 13:10:48.248412 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 143/289] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:10:48 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:10:48.347114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b682ba4d-0097-4c7b-adf0-7ae4e72917ba tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:48.347900 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b682ba4d-0097-4c7b-adf0-7ae4e72917ba tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:48.354748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b682ba4d-0097-4c7b-adf0-7ae4e72917ba tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:48.355191 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b682ba4d-0097-4c7b-adf0-7ae4e72917ba tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:48.355990 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b682ba4d-0097-4c7b-adf0-7ae4e72917ba tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:48.356423 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b682ba4d-0097-4c7b-adf0-7ae4e72917ba tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:48.418728 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b682ba4d-0097-4c7b-adf0-7ae4e72917ba tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:48.429734 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b682ba4d-0097-4c7b-adf0-7ae4e72917ba tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1249 microversion: 2.1 time: 0.083942 Jun 06 13:10:48.429734 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 147/290] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:48 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1249 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:48.680299 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-acc7471a-71e0-4674-83dc-abb6d561b7d6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Action: 'create', calling method: .version_select at 0x7f0efc29ff70>, body: {"keypair": {"name": "tempest-keypair-497649077", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCLC9vmMq2hciM1cOduB/iRfhBqFU8sjAgxYa9GJLDGsR/ArnzdgOgP8yh75txBLH/e56ntzDrLnizj2reG2MlGkjgufX6peqkLPlQ0WYRkNaZrTZzwkwj26eQv7w9Eyjg=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:48.694952 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-acc7471a-71e0-4674-83dc-abb6d561b7d6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for project d6db503a0a1749789e92ed63f5a113b7. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:10:48.699385 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-acc7471a-71e0-4674-83dc-abb6d561b7d6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for user 9c620175b84d4cee9aef398864c03c8d and project d6db503a0a1749789e92ed63f5a113b7. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:10:48.848775 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-acc7471a-71e0-4674-83dc-abb6d561b7d6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.174877 Jun 06 13:10:48.849373 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 144/291] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 13:10:48 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:10:49.266397 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c38bc084-4296-4d54-a24b-1c62120f928c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:49.267071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c38bc084-4296-4d54-a24b-1c62120f928c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:49.273369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c38bc084-4296-4d54-a24b-1c62120f928c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:49.273818 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c38bc084-4296-4d54-a24b-1c62120f928c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:49.274587 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c38bc084-4296-4d54-a24b-1c62120f928c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:49.274982 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c38bc084-4296-4d54-a24b-1c62120f928c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:49.409526 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c38bc084-4296-4d54-a24b-1c62120f928c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:49.417546 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c38bc084-4296-4d54-a24b-1c62120f928c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:49.419106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c38bc084-4296-4d54-a24b-1c62120f928c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:49.420290 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c38bc084-4296-4d54-a24b-1c62120f928c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.158263 Jun 06 13:10:49.420814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 148/292] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:10:49 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:10:49.443988 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-239c2d19-8313-4e81-841f-2a5a335a425d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:49.444776 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-239c2d19-8313-4e81-841f-2a5a335a425d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:49.451320 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-239c2d19-8313-4e81-841f-2a5a335a425d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:49.451836 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-239c2d19-8313-4e81-841f-2a5a335a425d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:49.452818 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-239c2d19-8313-4e81-841f-2a5a335a425d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:49.453260 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-239c2d19-8313-4e81-841f-2a5a335a425d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:49.515093 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-239c2d19-8313-4e81-841f-2a5a335a425d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:49.523487 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-239c2d19-8313-4e81-841f-2a5a335a425d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1297 microversion: 2.1 time: 0.083539 Jun 06 13:10:49.524075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 145/293] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:49 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1297 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:50.438412 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-483cb91d-b545-4785-b982-c8ef42a3e341 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:50.438940 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-483cb91d-b545-4785-b982-c8ef42a3e341 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:50.445621 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-483cb91d-b545-4785-b982-c8ef42a3e341 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:50.446325 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-483cb91d-b545-4785-b982-c8ef42a3e341 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:50.446873 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-483cb91d-b545-4785-b982-c8ef42a3e341 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:50.447309 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-483cb91d-b545-4785-b982-c8ef42a3e341 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:50.541512 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6dcc3357-ed65-4de3-a575-42da731bcbc8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:50.542279 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6dcc3357-ed65-4de3-a575-42da731bcbc8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:50.555577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6dcc3357-ed65-4de3-a575-42da731bcbc8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:50.555577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6dcc3357-ed65-4de3-a575-42da731bcbc8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:50.555577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6dcc3357-ed65-4de3-a575-42da731bcbc8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:50.555577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6dcc3357-ed65-4de3-a575-42da731bcbc8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:50.613381 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-483cb91d-b545-4785-b982-c8ef42a3e341 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:50.622138 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-483cb91d-b545-4785-b982-c8ef42a3e341 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:50.624928 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-483cb91d-b545-4785-b982-c8ef42a3e341 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:50.627122 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-483cb91d-b545-4785-b982-c8ef42a3e341 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.192585 Jun 06 13:10:50.628119 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 149/294] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:10:50 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:10:50.630811 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6dcc3357-ed65-4de3-a575-42da731bcbc8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:50.638249 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6dcc3357-ed65-4de3-a575-42da731bcbc8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1297 microversion: 2.1 time: 0.101641 Jun 06 13:10:50.643681 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 146/295] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:50 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1297 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:51.279931 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1639895619", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e6b38e7-6e44-43bf-a66b-a75358de1034"}], "security_groups": [{"name": "tempest-securitygroup--237277813"}], "key_name": "tempest-keypair-497649077", "user_data": "}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:51.287233 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=75,nova_api:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:51.647375 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c9f0974d-65df-44c4-9b38-d55a427c348c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:51.648003 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c9f0974d-65df-44c4-9b38-d55a427c348c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:51.654571 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c9f0974d-65df-44c4-9b38-d55a427c348c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:51.655017 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c9f0974d-65df-44c4-9b38-d55a427c348c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:51.655848 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c9f0974d-65df-44c4-9b38-d55a427c348c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:51.656283 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c9f0974d-65df-44c4-9b38-d55a427c348c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:51.792838 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c9f0974d-65df-44c4-9b38-d55a427c348c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:51.802106 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c9f0974d-65df-44c4-9b38-d55a427c348c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:51.803637 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c9f0974d-65df-44c4-9b38-d55a427c348c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:51.804806 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c9f0974d-65df-44c4-9b38-d55a427c348c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.161767 Jun 06 13:10:51.805372 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 147/296] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:10:51 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:10:51.809786 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-aa5f978e-d5b6-40fb-84e3-4bd020393c40 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:51.810382 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-aa5f978e-d5b6-40fb-84e3-4bd020393c40 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:51.817224 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa5f978e-d5b6-40fb-84e3-4bd020393c40 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:51.817690 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa5f978e-d5b6-40fb-84e3-4bd020393c40 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:51.818428 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa5f978e-d5b6-40fb-84e3-4bd020393c40 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:51.818859 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa5f978e-d5b6-40fb-84e3-4bd020393c40 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:51.903296 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-aa5f978e-d5b6-40fb-84e3-4bd020393c40 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:51.903296 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-aa5f978e-d5b6-40fb-84e3-4bd020393c40 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1297 microversion: 2.1 time: 0.094730 Jun 06 13:10:51.903296 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 148/297] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:51 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1297 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:52.823425 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8eb87759-33bd-4b93-8540-51621990d503 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:52.824499 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8eb87759-33bd-4b93-8540-51621990d503 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:52.832180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8eb87759-33bd-4b93-8540-51621990d503 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:52.837095 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8eb87759-33bd-4b93-8540-51621990d503 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:52.837095 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8eb87759-33bd-4b93-8540-51621990d503 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:52.837095 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8eb87759-33bd-4b93-8540-51621990d503 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:52.853144 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=94,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:52.988174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8eb87759-33bd-4b93-8540-51621990d503 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:53.001056 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8eb87759-33bd-4b93-8540-51621990d503 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:53.005530 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8eb87759-33bd-4b93-8540-51621990d503 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:53.005530 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8eb87759-33bd-4b93-8540-51621990d503 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.185279 Jun 06 13:10:53.005530 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 149/298] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:10:52 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:10:53.010326 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-676cdf5f-232b-4092-a013-e1fe717d9b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:53.011006 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-676cdf5f-232b-4092-a013-e1fe717d9b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:53.031094 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-676cdf5f-232b-4092-a013-e1fe717d9b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:53.043748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-676cdf5f-232b-4092-a013-e1fe717d9b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:53.043748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-676cdf5f-232b-4092-a013-e1fe717d9b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:53.043748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-676cdf5f-232b-4092-a013-e1fe717d9b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:53.100849 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-676cdf5f-232b-4092-a013-e1fe717d9b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:53.108237 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-676cdf5f-232b-4092-a013-e1fe717d9b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1303 microversion: 2.1 time: 0.101447 Jun 06 13:10:53.108801 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 150/299] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:53 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1303 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:54.023919 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9079f274-1495-4213-9552-1fb36db21708 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:54.024576 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9079f274-1495-4213-9552-1fb36db21708 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:54.032501 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9079f274-1495-4213-9552-1fb36db21708 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:54.033215 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9079f274-1495-4213-9552-1fb36db21708 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:54.034895 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9079f274-1495-4213-9552-1fb36db21708 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:54.036019 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9079f274-1495-4213-9552-1fb36db21708 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:54.217623 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9079f274-1495-4213-9552-1fb36db21708 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:54.226799 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9079f274-1495-4213-9552-1fb36db21708 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:54.228349 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9079f274-1495-4213-9552-1fb36db21708 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:54.229499 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9079f274-1495-4213-9552-1fb36db21708 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.210558 Jun 06 13:10:54.230052 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 151/300] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:10:54 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:10:54.234368 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cd34f44b-db9c-4607-ac7e-842c56bc48c7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:54.236118 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cd34f44b-db9c-4607-ac7e-842c56bc48c7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:54.241431 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd34f44b-db9c-4607-ac7e-842c56bc48c7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:54.241879 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd34f44b-db9c-4607-ac7e-842c56bc48c7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:54.242643 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd34f44b-db9c-4607-ac7e-842c56bc48c7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:54.243076 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cd34f44b-db9c-4607-ac7e-842c56bc48c7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:54.405932 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cd34f44b-db9c-4607-ac7e-842c56bc48c7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:54.414393 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cd34f44b-db9c-4607-ac7e-842c56bc48c7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1370 microversion: 2.1 time: 0.183305 Jun 06 13:10:54.415174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 152/301] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:54 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:54.419744 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-6102548e-bfec-431b-9215-33f21f856a7f req-6d88aea3-1f50-4641-b6c2-c63a535f6f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed", "tag": "f0e7842e-73e3-4514-a0b0-f79d3d8a84f2"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:54.428055 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-6102548e-bfec-431b-9215-33f21f856a7f req-6d88aea3-1f50-4641-b6c2-c63a535f6f38 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:54.428492 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-6102548e-bfec-431b-9215-33f21f856a7f req-6d88aea3-1f50-4641-b6c2-c63a535f6f38 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:54.440186 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-6102548e-bfec-431b-9215-33f21f856a7f req-6d88aea3-1f50-4641-b6c2-c63a535f6f38 service nova] Creating event network-changed:f0e7842e-73e3-4514-a0b0-f79d3d8a84f2 for instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed on hv-cinder-75510 Jun 06 13:10:54.445340 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-6102548e-bfec-431b-9215-33f21f856a7f req-6d88aea3-1f50-4641-b6c2-c63a535f6f38 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.028964 Jun 06 13:10:54.446269 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 153/302] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:10:55.249341 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dec5e609-d33d-48b8-b08a-d490fa9ffdbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:55.250112 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dec5e609-d33d-48b8-b08a-d490fa9ffdbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:55.256620 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dec5e609-d33d-48b8-b08a-d490fa9ffdbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:55.257090 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dec5e609-d33d-48b8-b08a-d490fa9ffdbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:55.257897 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dec5e609-d33d-48b8-b08a-d490fa9ffdbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:55.258329 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dec5e609-d33d-48b8-b08a-d490fa9ffdbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:55.403493 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dec5e609-d33d-48b8-b08a-d490fa9ffdbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:55.412664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dec5e609-d33d-48b8-b08a-d490fa9ffdbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:55.414183 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dec5e609-d33d-48b8-b08a-d490fa9ffdbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:55.415346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dec5e609-d33d-48b8-b08a-d490fa9ffdbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.170831 Jun 06 13:10:55.416203 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 154/303] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:10:55 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:10:55.431237 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3fabeaba-773a-4cab-b980-2cef6936c68c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:55.432129 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3fabeaba-773a-4cab-b980-2cef6936c68c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:55.439677 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3fabeaba-773a-4cab-b980-2cef6936c68c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:55.440325 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3fabeaba-773a-4cab-b980-2cef6936c68c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:55.442417 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3fabeaba-773a-4cab-b980-2cef6936c68c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:55.443402 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3fabeaba-773a-4cab-b980-2cef6936c68c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:55.581258 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3fabeaba-773a-4cab-b980-2cef6936c68c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:55.589871 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3fabeaba-773a-4cab-b980-2cef6936c68c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1370 microversion: 2.1 time: 0.162621 Jun 06 13:10:55.592652 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 155/304] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:55 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1370 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:56.093514 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c5e3add1-1af0-4449-8fdd-5c91786673b8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:10:56.100248 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c5e3add1-1af0-4449-8fdd-5c91786673b8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:56.100725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c5e3add1-1af0-4449-8fdd-5c91786673b8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:56.166302 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c5e3add1-1af0-4449-8fdd-5c91786673b8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Going to try to stop instance {{(pid=118133) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 06 13:10:56.338225 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c5e3add1-1af0-4449-8fdd-5c91786673b8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "POST /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/action" status: 202 len: 0 microversion: 2.1 time: 0.248336 Jun 06 13:10:56.341963 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 156/305] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:10:56 2022] POST /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/action => generated 0 bytes in 250 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 13:10:56.347842 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c75eb315-86cd-4ecc-8f2a-183f70ae132d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:56.348673 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c75eb315-86cd-4ecc-8f2a-183f70ae132d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:56.354997 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c75eb315-86cd-4ecc-8f2a-183f70ae132d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:56.355509 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c75eb315-86cd-4ecc-8f2a-183f70ae132d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:56.361458 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c75eb315-86cd-4ecc-8f2a-183f70ae132d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:56.361458 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c75eb315-86cd-4ecc-8f2a-183f70ae132d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:56.451103 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.network.neutron [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] validate_networks() for [('2e6b38e7-6e44-43bf-a66b-a75358de1034', None, None, None, None, None)] {{(pid=118134) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:10:56.579067 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c75eb315-86cd-4ecc-8f2a-183f70ae132d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:56.588634 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c75eb315-86cd-4ecc-8f2a-183f70ae132d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.244688 Jun 06 13:10:56.589420 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 157/306] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:56 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:56.594308 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4519063a-2766-406e-b0bd-dd79d2ca05d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:56.595139 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4519063a-2766-406e-b0bd-dd79d2ca05d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:56.605367 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4519063a-2766-406e-b0bd-dd79d2ca05d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:56.605823 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4519063a-2766-406e-b0bd-dd79d2ca05d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:56.606590 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4519063a-2766-406e-b0bd-dd79d2ca05d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:56.607129 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4519063a-2766-406e-b0bd-dd79d2ca05d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:56.837757 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4519063a-2766-406e-b0bd-dd79d2ca05d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:56.851831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4519063a-2766-406e-b0bd-dd79d2ca05d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:56.851831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4519063a-2766-406e-b0bd-dd79d2ca05d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:56.851831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4519063a-2766-406e-b0bd-dd79d2ca05d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.259964 Jun 06 13:10:56.852114 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 158/307] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:10:56 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:10:56.857208 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-79a4b4fc-5c80-468a-82db-3956b3cb9846 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:56.857824 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-79a4b4fc-5c80-468a-82db-3956b3cb9846 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:56.864822 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79a4b4fc-5c80-468a-82db-3956b3cb9846 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:56.872573 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79a4b4fc-5c80-468a-82db-3956b3cb9846 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:56.872573 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79a4b4fc-5c80-468a-82db-3956b3cb9846 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:56.872573 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79a4b4fc-5c80-468a-82db-3956b3cb9846 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:57.014088 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Flavor limits 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:10:57.014930 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Image limits 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:10:57.015639 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Flavor pref 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:10:57.016260 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Image pref 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:10:57.016882 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:10:57.030626 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:57.031283 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:57.032645 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:57.035132 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:57.046421 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-79a4b4fc-5c80-468a-82db-3956b3cb9846 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:57.057608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-79a4b4fc-5c80-468a-82db-3956b3cb9846 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1370 microversion: 2.1 time: 0.204730 Jun 06 13:10:57.058273 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 159/308] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:56 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:57.060462 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for project d6db503a0a1749789e92ed63f5a113b7. Resources: {'cores', 'ram', 'instances'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:10:57.064582 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for user 9c620175b84d4cee9aef398864c03c8d and project d6db503a0a1749789e92ed63f5a113b7. Resources: {'cores', 'ram', 'instances'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:10:57.076274 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Going to run 1 instances... {{(pid=118134) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:10:57.078714 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:10:57.181726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b260a3a3-a037-4d4a-b241-c40d2196c9e8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 5.906091 Jun 06 13:10:57.182361 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 150/309] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:10:51 2022] POST /compute/v2.1/servers => generated 401 bytes in 5907 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:10:57.192945 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a3a77544-5efd-479b-a33d-100028699231 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:57.193473 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a3a77544-5efd-479b-a33d-100028699231 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:57.195387 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:57.247209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a3a77544-5efd-479b-a33d-100028699231 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:57.256922 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a3a77544-5efd-479b-a33d-100028699231 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1241 microversion: 2.1 time: 0.067733 Jun 06 13:10:57.265108 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 160/310] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:57 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1241 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:57.607083 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ad94b7fd-7ebe-4a4c-a349-38d9b3d345ef tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:57.609548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ad94b7fd-7ebe-4a4c-a349-38d9b3d345ef tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:57.615611 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ad94b7fd-7ebe-4a4c-a349-38d9b3d345ef tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:57.616067 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ad94b7fd-7ebe-4a4c-a349-38d9b3d345ef tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:57.616834 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ad94b7fd-7ebe-4a4c-a349-38d9b3d345ef tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:57.617274 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ad94b7fd-7ebe-4a4c-a349-38d9b3d345ef tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:57.632290 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:10:57.751634 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ad94b7fd-7ebe-4a4c-a349-38d9b3d345ef tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:57.759908 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ad94b7fd-7ebe-4a4c-a349-38d9b3d345ef tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.157069 Jun 06 13:10:57.760556 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 151/311] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:57 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:57.869776 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8a0b7aa7-83fc-4a15-861a-7e542b9846f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:57.870441 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8a0b7aa7-83fc-4a15-861a-7e542b9846f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:57.876869 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8a0b7aa7-83fc-4a15-861a-7e542b9846f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:57.877318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8a0b7aa7-83fc-4a15-861a-7e542b9846f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:57.881808 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8a0b7aa7-83fc-4a15-861a-7e542b9846f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:57.881808 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8a0b7aa7-83fc-4a15-861a-7e542b9846f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:58.011701 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8a0b7aa7-83fc-4a15-861a-7e542b9846f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:58.020688 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8a0b7aa7-83fc-4a15-861a-7e542b9846f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:58.022208 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8a0b7aa7-83fc-4a15-861a-7e542b9846f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:58.023418 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8a0b7aa7-83fc-4a15-861a-7e542b9846f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.157467 Jun 06 13:10:58.023983 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 161/312] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:10:57 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:10:58.075098 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a8fca103-d456-4d82-8031-727f98080c10 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:58.075712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a8fca103-d456-4d82-8031-727f98080c10 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:58.082608 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a8fca103-d456-4d82-8031-727f98080c10 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:58.083041 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a8fca103-d456-4d82-8031-727f98080c10 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:58.083815 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a8fca103-d456-4d82-8031-727f98080c10 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:58.084242 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a8fca103-d456-4d82-8031-727f98080c10 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:58.214714 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a8fca103-d456-4d82-8031-727f98080c10 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:58.222109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a8fca103-d456-4d82-8031-727f98080c10 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1370 microversion: 2.1 time: 0.150815 Jun 06 13:10:58.222753 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 152/313] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:58 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1370 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:58.274565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fbfe2285-9c45-44cd-88e3-12600a8c4acf tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:58.275109 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fbfe2285-9c45-44cd-88e3-12600a8c4acf tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:58.281762 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fbfe2285-9c45-44cd-88e3-12600a8c4acf tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:58.282220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fbfe2285-9c45-44cd-88e3-12600a8c4acf tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:58.283103 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fbfe2285-9c45-44cd-88e3-12600a8c4acf tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:58.283403 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fbfe2285-9c45-44cd-88e3-12600a8c4acf tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:58.348762 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fbfe2285-9c45-44cd-88e3-12600a8c4acf tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:58.356260 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fbfe2285-9c45-44cd-88e3-12600a8c4acf tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1245 microversion: 2.1 time: 0.085578 Jun 06 13:10:58.356818 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 162/314] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:58 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1245 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:58.777884 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9d36fe4a-63e5-4c00-bbaa-e71247fc0f6b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:58.778493 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9d36fe4a-63e5-4c00-bbaa-e71247fc0f6b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:58.784973 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9d36fe4a-63e5-4c00-bbaa-e71247fc0f6b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:58.785695 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9d36fe4a-63e5-4c00-bbaa-e71247fc0f6b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:58.786462 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9d36fe4a-63e5-4c00-bbaa-e71247fc0f6b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:58.786897 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9d36fe4a-63e5-4c00-bbaa-e71247fc0f6b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:58.916396 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9d36fe4a-63e5-4c00-bbaa-e71247fc0f6b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:58.925321 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9d36fe4a-63e5-4c00-bbaa-e71247fc0f6b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.151138 Jun 06 13:10:58.926375 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 153/315] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:58 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:59.042222 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4faaaba1-580b-4f4f-a1b5-665aa1a90ad7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:59.042823 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4faaaba1-580b-4f4f-a1b5-665aa1a90ad7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:59.048860 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4faaaba1-580b-4f4f-a1b5-665aa1a90ad7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:59.051186 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4faaaba1-580b-4f4f-a1b5-665aa1a90ad7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:59.051186 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4faaaba1-580b-4f4f-a1b5-665aa1a90ad7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:59.051186 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4faaaba1-580b-4f4f-a1b5-665aa1a90ad7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:59.178605 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4faaaba1-580b-4f4f-a1b5-665aa1a90ad7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:59.186399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4faaaba1-580b-4f4f-a1b5-665aa1a90ad7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:59.187915 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4faaaba1-580b-4f4f-a1b5-665aa1a90ad7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:59.189045 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4faaaba1-580b-4f4f-a1b5-665aa1a90ad7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.150821 Jun 06 13:10:59.189587 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 163/316] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:10:59 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:10:59.240135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ed2970bd-74ad-4037-8c7c-8ecda2929850 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:59.241115 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ed2970bd-74ad-4037-8c7c-8ecda2929850 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:59.250858 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ed2970bd-74ad-4037-8c7c-8ecda2929850 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:59.251637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ed2970bd-74ad-4037-8c7c-8ecda2929850 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:59.252923 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ed2970bd-74ad-4037-8c7c-8ecda2929850 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:59.253666 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ed2970bd-74ad-4037-8c7c-8ecda2929850 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:59.378717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f98a343c-28ee-4732-ae58-afa493ce1bb6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:59.378717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f98a343c-28ee-4732-ae58-afa493ce1bb6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:59.387765 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f98a343c-28ee-4732-ae58-afa493ce1bb6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:59.387765 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f98a343c-28ee-4732-ae58-afa493ce1bb6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:59.387765 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f98a343c-28ee-4732-ae58-afa493ce1bb6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:59.387765 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f98a343c-28ee-4732-ae58-afa493ce1bb6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:59.396504 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ed2970bd-74ad-4037-8c7c-8ecda2929850 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:59.404240 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ed2970bd-74ad-4037-8c7c-8ecda2929850 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1370 microversion: 2.1 time: 0.169188 Jun 06 13:10:59.404916 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 154/317] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:59 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1370 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:10:59.451493 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f98a343c-28ee-4732-ae58-afa493ce1bb6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:10:59.460433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f98a343c-28ee-4732-ae58-afa493ce1bb6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1245 microversion: 2.1 time: 0.090755 Jun 06 13:10:59.461134 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 164/318] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:59 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1245 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:10:59.943577 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-805249c0-7e4f-4739-baba-6473bfc22ba9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:10:59.944225 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-805249c0-7e4f-4739-baba-6473bfc22ba9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:10:59.950824 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-805249c0-7e4f-4739-baba-6473bfc22ba9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:59.951274 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-805249c0-7e4f-4739-baba-6473bfc22ba9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:10:59.952067 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-805249c0-7e4f-4739-baba-6473bfc22ba9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:10:59.952504 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-805249c0-7e4f-4739-baba-6473bfc22ba9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:00.081541 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-805249c0-7e4f-4739-baba-6473bfc22ba9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:00.090154 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-805249c0-7e4f-4739-baba-6473bfc22ba9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.151078 Jun 06 13:11:00.090723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 155/319] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:10:59 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:00.206247 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0799fc66-18f4-42f3-b5ef-4a5605089532 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:00.206846 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0799fc66-18f4-42f3-b5ef-4a5605089532 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:00.212987 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0799fc66-18f4-42f3-b5ef-4a5605089532 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:00.213483 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0799fc66-18f4-42f3-b5ef-4a5605089532 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:00.214227 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0799fc66-18f4-42f3-b5ef-4a5605089532 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:00.214654 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0799fc66-18f4-42f3-b5ef-4a5605089532 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:00.345354 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0799fc66-18f4-42f3-b5ef-4a5605089532 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:00.353201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0799fc66-18f4-42f3-b5ef-4a5605089532 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:00.354725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0799fc66-18f4-42f3-b5ef-4a5605089532 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:00.355930 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0799fc66-18f4-42f3-b5ef-4a5605089532 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.153611 Jun 06 13:11:00.356484 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 165/320] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:00 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:00.421755 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e6ec6b13-e0b0-46a3-bfd5-25f746ef3893 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:00.422598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e6ec6b13-e0b0-46a3-bfd5-25f746ef3893 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:00.430751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e6ec6b13-e0b0-46a3-bfd5-25f746ef3893 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:00.431343 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e6ec6b13-e0b0-46a3-bfd5-25f746ef3893 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:00.432176 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e6ec6b13-e0b0-46a3-bfd5-25f746ef3893 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:00.437302 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e6ec6b13-e0b0-46a3-bfd5-25f746ef3893 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:00.477779 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-69c012c0-ce0b-4617-b92f-aecf34554092 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:00.478410 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-69c012c0-ce0b-4617-b92f-aecf34554092 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:00.485163 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-69c012c0-ce0b-4617-b92f-aecf34554092 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:00.485604 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-69c012c0-ce0b-4617-b92f-aecf34554092 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:00.486475 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-69c012c0-ce0b-4617-b92f-aecf34554092 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:00.487102 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-69c012c0-ce0b-4617-b92f-aecf34554092 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:00.562352 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-69c012c0-ce0b-4617-b92f-aecf34554092 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:00.564577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:00.570599 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-69c012c0-ce0b-4617-b92f-aecf34554092 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1245 microversion: 2.1 time: 0.096756 Jun 06 13:11:00.571160 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 166/321] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:00 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1245 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:00.598188 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e6ec6b13-e0b0-46a3-bfd5-25f746ef3893 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:00.605327 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e6ec6b13-e0b0-46a3-bfd5-25f746ef3893 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1370 microversion: 2.1 time: 0.187584 Jun 06 13:11:00.605890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 156/322] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:00 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1370 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:01.108305 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-aa6c601f-2c98-4b24-b054-651475dd6d63 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:01.108829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-aa6c601f-2c98-4b24-b054-651475dd6d63 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:01.115272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa6c601f-2c98-4b24-b054-651475dd6d63 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:01.115744 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa6c601f-2c98-4b24-b054-651475dd6d63 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:01.116582 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa6c601f-2c98-4b24-b054-651475dd6d63 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:01.117015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa6c601f-2c98-4b24-b054-651475dd6d63 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:01.259240 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-aa6c601f-2c98-4b24-b054-651475dd6d63 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:01.267152 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-aa6c601f-2c98-4b24-b054-651475dd6d63 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.163194 Jun 06 13:11:01.267735 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 167/323] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:01 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:01.374749 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3dd34cc3-cc1f-4b43-811a-ac84d136c137 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:01.375202 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3dd34cc3-cc1f-4b43-811a-ac84d136c137 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:01.382077 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3dd34cc3-cc1f-4b43-811a-ac84d136c137 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:01.382549 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3dd34cc3-cc1f-4b43-811a-ac84d136c137 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:01.383340 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3dd34cc3-cc1f-4b43-811a-ac84d136c137 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:01.383752 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3dd34cc3-cc1f-4b43-811a-ac84d136c137 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:01.519107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3dd34cc3-cc1f-4b43-811a-ac84d136c137 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:01.528798 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3dd34cc3-cc1f-4b43-811a-ac84d136c137 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:01.530477 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3dd34cc3-cc1f-4b43-811a-ac84d136c137 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:01.531842 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3dd34cc3-cc1f-4b43-811a-ac84d136c137 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.161371 Jun 06 13:11:01.532384 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 157/324] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:01 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:01.589693 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3cc2124f-1958-4427-a8d1-15a3958f8789 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:01.590444 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3cc2124f-1958-4427-a8d1-15a3958f8789 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:01.597562 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3cc2124f-1958-4427-a8d1-15a3958f8789 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:01.598135 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3cc2124f-1958-4427-a8d1-15a3958f8789 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:01.598897 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3cc2124f-1958-4427-a8d1-15a3958f8789 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:01.599319 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3cc2124f-1958-4427-a8d1-15a3958f8789 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:01.622079 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f5b73dab-4cf0-4555-b40d-c67497f7b380 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:01.622647 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f5b73dab-4cf0-4555-b40d-c67497f7b380 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:01.628698 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f5b73dab-4cf0-4555-b40d-c67497f7b380 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:01.629827 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f5b73dab-4cf0-4555-b40d-c67497f7b380 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:01.630911 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f5b73dab-4cf0-4555-b40d-c67497f7b380 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:01.631352 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f5b73dab-4cf0-4555-b40d-c67497f7b380 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:01.660993 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3cc2124f-1958-4427-a8d1-15a3958f8789 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:01.668489 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3cc2124f-1958-4427-a8d1-15a3958f8789 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1245 microversion: 2.1 time: 0.083569 Jun 06 13:11:01.669044 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 168/325] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:01 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1245 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:01.764497 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f5b73dab-4cf0-4555-b40d-c67497f7b380 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:01.772961 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f5b73dab-4cf0-4555-b40d-c67497f7b380 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1370 microversion: 2.1 time: 0.154692 Jun 06 13:11:01.773532 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 158/326] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:01 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1370 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:11:02.284077 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b8d40fbb-169a-4b39-8fec-1e06439a7e15 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:02.284686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b8d40fbb-169a-4b39-8fec-1e06439a7e15 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:02.291369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b8d40fbb-169a-4b39-8fec-1e06439a7e15 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:02.291856 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b8d40fbb-169a-4b39-8fec-1e06439a7e15 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:02.292636 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b8d40fbb-169a-4b39-8fec-1e06439a7e15 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:02.293069 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b8d40fbb-169a-4b39-8fec-1e06439a7e15 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:02.422250 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b8d40fbb-169a-4b39-8fec-1e06439a7e15 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:02.431097 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b8d40fbb-169a-4b39-8fec-1e06439a7e15 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.150821 Jun 06 13:11:02.431770 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 169/327] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:02 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:02.549437 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d2a4f6f2-db0a-410e-a605-e41dacda791a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:02.550049 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d2a4f6f2-db0a-410e-a605-e41dacda791a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:02.556661 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d2a4f6f2-db0a-410e-a605-e41dacda791a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:02.557109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d2a4f6f2-db0a-410e-a605-e41dacda791a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:02.557875 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d2a4f6f2-db0a-410e-a605-e41dacda791a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:02.558309 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d2a4f6f2-db0a-410e-a605-e41dacda791a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:02.686450 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1254d06f-a9c8-48a8-9d22-252dccb762ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:02.687309 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1254d06f-a9c8-48a8-9d22-252dccb762ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:02.694949 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1254d06f-a9c8-48a8-9d22-252dccb762ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:02.695386 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1254d06f-a9c8-48a8-9d22-252dccb762ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:02.695510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d2a4f6f2-db0a-410e-a605-e41dacda791a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:02.696234 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1254d06f-a9c8-48a8-9d22-252dccb762ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:02.697340 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1254d06f-a9c8-48a8-9d22-252dccb762ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:02.704246 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d2a4f6f2-db0a-410e-a605-e41dacda791a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:02.705855 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d2a4f6f2-db0a-410e-a605-e41dacda791a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:02.707984 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d2a4f6f2-db0a-410e-a605-e41dacda791a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.161628 Jun 06 13:11:02.715666 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 159/328] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:02 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:02.790755 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9a09d927-ea5e-4801-9125-743a249dd87d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:02.791489 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9a09d927-ea5e-4801-9125-743a249dd87d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:02.798430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9a09d927-ea5e-4801-9125-743a249dd87d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:02.798973 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9a09d927-ea5e-4801-9125-743a249dd87d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:02.799796 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9a09d927-ea5e-4801-9125-743a249dd87d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:02.800235 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9a09d927-ea5e-4801-9125-743a249dd87d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:02.984896 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1254d06f-a9c8-48a8-9d22-252dccb762ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:02.992821 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1254d06f-a9c8-48a8-9d22-252dccb762ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1293 microversion: 2.1 time: 0.310549 Jun 06 13:11:02.993629 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 170/329] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:02 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1293 bytes in 312 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:03.075968 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9a09d927-ea5e-4801-9125-743a249dd87d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:03.084520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9a09d927-ea5e-4801-9125-743a249dd87d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1370 microversion: 2.1 time: 0.297790 Jun 06 13:11:03.085092 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 160/330] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:02 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1370 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:11:03.450099 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9612a66b-9b23-4145-9b79-486f1d72630c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:03.450858 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9612a66b-9b23-4145-9b79-486f1d72630c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:03.459702 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9612a66b-9b23-4145-9b79-486f1d72630c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:03.460401 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9612a66b-9b23-4145-9b79-486f1d72630c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:03.461317 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9612a66b-9b23-4145-9b79-486f1d72630c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:03.462043 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9612a66b-9b23-4145-9b79-486f1d72630c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:03.629969 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-64a184ab-e39f-4753-833d-5319f6ab4b78 req-8d76084a-0249-4a62-9f36-a67108418558 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed", "name": "network-vif-plugged", "status": "completed", "tag": "f0e7842e-73e3-4514-a0b0-f79d3d8a84f2"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:11:03.631994 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9612a66b-9b23-4145-9b79-486f1d72630c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:03.640542 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-64a184ab-e39f-4753-833d-5319f6ab4b78 req-8d76084a-0249-4a62-9f36-a67108418558 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:03.640542 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-64a184ab-e39f-4753-833d-5319f6ab4b78 req-8d76084a-0249-4a62-9f36-a67108418558 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:03.640766 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9612a66b-9b23-4145-9b79-486f1d72630c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.194560 Jun 06 13:11:03.643705 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 171/331] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:03 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:03.653513 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-64a184ab-e39f-4753-833d-5319f6ab4b78 req-8d76084a-0249-4a62-9f36-a67108418558 service nova] Creating event network-vif-plugged:f0e7842e-73e3-4514-a0b0-f79d3d8a84f2 for instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed on hv-cinder-75510 Jun 06 13:11:03.658615 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-64a184ab-e39f-4753-833d-5319f6ab4b78 req-8d76084a-0249-4a62-9f36-a67108418558 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035453 Jun 06 13:11:03.659753 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 161/332] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:11:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:11:03.727237 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d0787f20-5ae6-4e4e-9c7b-99d441bcd6d9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:03.727868 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d0787f20-5ae6-4e4e-9c7b-99d441bcd6d9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:03.734360 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0787f20-5ae6-4e4e-9c7b-99d441bcd6d9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:03.734809 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0787f20-5ae6-4e4e-9c7b-99d441bcd6d9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:03.735600 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0787f20-5ae6-4e4e-9c7b-99d441bcd6d9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:03.736036 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0787f20-5ae6-4e4e-9c7b-99d441bcd6d9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:03.887265 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0787f20-5ae6-4e4e-9c7b-99d441bcd6d9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:03.896139 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0787f20-5ae6-4e4e-9c7b-99d441bcd6d9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:03.897658 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0787f20-5ae6-4e4e-9c7b-99d441bcd6d9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:03.898828 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d0787f20-5ae6-4e4e-9c7b-99d441bcd6d9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.176166 Jun 06 13:11:03.899593 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 172/333] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:03 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:04.009970 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5678c6ce-badf-46c7-a8fb-7af9c71c0866 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:04.010670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5678c6ce-badf-46c7-a8fb-7af9c71c0866 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:04.016943 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5678c6ce-badf-46c7-a8fb-7af9c71c0866 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:04.017389 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5678c6ce-badf-46c7-a8fb-7af9c71c0866 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:04.018152 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5678c6ce-badf-46c7-a8fb-7af9c71c0866 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:04.021832 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5678c6ce-badf-46c7-a8fb-7af9c71c0866 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:04.084570 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5678c6ce-badf-46c7-a8fb-7af9c71c0866 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:04.091977 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5678c6ce-badf-46c7-a8fb-7af9c71c0866 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1299 microversion: 2.1 time: 0.086351 Jun 06 13:11:04.092545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 162/334] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:04 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1299 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:04.107244 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2b241a9b-2c8c-466d-9fbf-bb371a04685e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:04.107889 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2b241a9b-2c8c-466d-9fbf-bb371a04685e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:04.113803 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b241a9b-2c8c-466d-9fbf-bb371a04685e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:04.114626 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b241a9b-2c8c-466d-9fbf-bb371a04685e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:04.115385 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b241a9b-2c8c-466d-9fbf-bb371a04685e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:04.115842 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b241a9b-2c8c-466d-9fbf-bb371a04685e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:04.268497 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2b241a9b-2c8c-466d-9fbf-bb371a04685e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:04.278719 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2b241a9b-2c8c-466d-9fbf-bb371a04685e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1370 microversion: 2.1 time: 0.175210 Jun 06 13:11:04.290202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 173/335] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:04 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1370 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:04.659973 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-56c01828-e24e-40f3-b9bb-226cb5d24c5b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:04.660702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-56c01828-e24e-40f3-b9bb-226cb5d24c5b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:04.668519 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-56c01828-e24e-40f3-b9bb-226cb5d24c5b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:04.668977 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-56c01828-e24e-40f3-b9bb-226cb5d24c5b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:04.669759 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-56c01828-e24e-40f3-b9bb-226cb5d24c5b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:04.670198 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-56c01828-e24e-40f3-b9bb-226cb5d24c5b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:04.854680 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-56c01828-e24e-40f3-b9bb-226cb5d24c5b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:04.863139 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-56c01828-e24e-40f3-b9bb-226cb5d24c5b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.208882 Jun 06 13:11:04.863775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 163/336] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:04 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:04.919200 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c98b2eb5-2c7b-4e38-b0ce-b3dd416235b8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:04.919875 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c98b2eb5-2c7b-4e38-b0ce-b3dd416235b8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:04.934881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c98b2eb5-2c7b-4e38-b0ce-b3dd416235b8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:04.935331 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c98b2eb5-2c7b-4e38-b0ce-b3dd416235b8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:04.936132 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c98b2eb5-2c7b-4e38-b0ce-b3dd416235b8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:04.936576 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c98b2eb5-2c7b-4e38-b0ce-b3dd416235b8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:05.096173 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c98b2eb5-2c7b-4e38-b0ce-b3dd416235b8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:05.105649 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c98b2eb5-2c7b-4e38-b0ce-b3dd416235b8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:05.107592 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c98b2eb5-2c7b-4e38-b0ce-b3dd416235b8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:05.110091 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c98b2eb5-2c7b-4e38-b0ce-b3dd416235b8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.194065 Jun 06 13:11:05.110390 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-64b5f362-04c3-43f1-8fe6-a8277f3d54dd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:05.111053 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-64b5f362-04c3-43f1-8fe6-a8277f3d54dd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:05.111832 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 174/337] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:04 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:05.119800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-64b5f362-04c3-43f1-8fe6-a8277f3d54dd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:05.120493 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-64b5f362-04c3-43f1-8fe6-a8277f3d54dd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:05.121449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-64b5f362-04c3-43f1-8fe6-a8277f3d54dd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:05.122032 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-64b5f362-04c3-43f1-8fe6-a8277f3d54dd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:05.272126 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-64b5f362-04c3-43f1-8fe6-a8277f3d54dd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:05.279928 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-64b5f362-04c3-43f1-8fe6-a8277f3d54dd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.173391 Jun 06 13:11:05.280695 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 164/338] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:05 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:11:05.296599 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d795e357-6e9c-45c6-ba2f-05991f8635e8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:05.297135 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d795e357-6e9c-45c6-ba2f-05991f8635e8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:05.304472 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d795e357-6e9c-45c6-ba2f-05991f8635e8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:05.305108 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d795e357-6e9c-45c6-ba2f-05991f8635e8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:05.306181 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d795e357-6e9c-45c6-ba2f-05991f8635e8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:05.306895 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d795e357-6e9c-45c6-ba2f-05991f8635e8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:05.336479 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-fbe7069d-8aec-497c-acca-b0ebb47e2237 req-ae85e511-dbc9-414d-abb8-aee187fdf05a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02dfda62-0a51-417a-807a-c653d5fc26db", "tag": "8c71242d-a06b-44fd-b334-7c6b540ac882"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:11:05.347570 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-fbe7069d-8aec-497c-acca-b0ebb47e2237 req-ae85e511-dbc9-414d-abb8-aee187fdf05a service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:05.348363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-fbe7069d-8aec-497c-acca-b0ebb47e2237 req-ae85e511-dbc9-414d-abb8-aee187fdf05a service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:05.361900 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-fbe7069d-8aec-497c-acca-b0ebb47e2237 req-ae85e511-dbc9-414d-abb8-aee187fdf05a service nova] Creating event network-changed:8c71242d-a06b-44fd-b334-7c6b540ac882 for instance 02dfda62-0a51-417a-807a-c653d5fc26db on hv-cinder-75510 Jun 06 13:11:05.368803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-fbe7069d-8aec-497c-acca-b0ebb47e2237 req-ae85e511-dbc9-414d-abb8-aee187fdf05a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039583 Jun 06 13:11:05.370100 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 165/339] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:11:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:11:05.498401 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d795e357-6e9c-45c6-ba2f-05991f8635e8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:05.508941 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d795e357-6e9c-45c6-ba2f-05991f8635e8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1370 microversion: 2.1 time: 0.216354 Jun 06 13:11:05.510013 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 175/340] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:05 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1370 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:11:05.881211 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-46365ba0-81c3-45b1-aedf-b8715c6e352d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:05.881908 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-46365ba0-81c3-45b1-aedf-b8715c6e352d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:05.889380 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-46365ba0-81c3-45b1-aedf-b8715c6e352d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:05.889883 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-46365ba0-81c3-45b1-aedf-b8715c6e352d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:05.890879 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-46365ba0-81c3-45b1-aedf-b8715c6e352d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:05.891639 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-46365ba0-81c3-45b1-aedf-b8715c6e352d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:06.028235 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-46365ba0-81c3-45b1-aedf-b8715c6e352d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:06.036974 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-46365ba0-81c3-45b1-aedf-b8715c6e352d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.160118 Jun 06 13:11:06.037541 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 166/341] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:05 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:11:06.130729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fe018c7e-6c72-4e11-bdee-c82260cf9321 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:06.131323 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fe018c7e-6c72-4e11-bdee-c82260cf9321 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:06.137745 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fe018c7e-6c72-4e11-bdee-c82260cf9321 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:06.138199 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fe018c7e-6c72-4e11-bdee-c82260cf9321 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:06.138942 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fe018c7e-6c72-4e11-bdee-c82260cf9321 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:06.139369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fe018c7e-6c72-4e11-bdee-c82260cf9321 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:06.268940 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fe018c7e-6c72-4e11-bdee-c82260cf9321 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:06.279514 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fe018c7e-6c72-4e11-bdee-c82260cf9321 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:06.281043 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fe018c7e-6c72-4e11-bdee-c82260cf9321 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:06.282224 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fe018c7e-6c72-4e11-bdee-c82260cf9321 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.155868 Jun 06 13:11:06.282860 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 176/342] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:06 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:06.296907 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c0711f69-599b-400e-a8d1-01bff18ebc73 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:06.297516 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c0711f69-599b-400e-a8d1-01bff18ebc73 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:06.303669 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c0711f69-599b-400e-a8d1-01bff18ebc73 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:06.304117 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c0711f69-599b-400e-a8d1-01bff18ebc73 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:06.305669 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c0711f69-599b-400e-a8d1-01bff18ebc73 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:06.305669 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c0711f69-599b-400e-a8d1-01bff18ebc73 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:06.434284 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c0711f69-599b-400e-a8d1-01bff18ebc73 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:06.441760 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c0711f69-599b-400e-a8d1-01bff18ebc73 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.148744 Jun 06 13:11:06.442341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 167/343] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:06 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:06.526500 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e493902e-9bd9-45fc-8052-6573962e7663 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:06.527130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e493902e-9bd9-45fc-8052-6573962e7663 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:06.533232 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e493902e-9bd9-45fc-8052-6573962e7663 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:06.533704 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e493902e-9bd9-45fc-8052-6573962e7663 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:06.534464 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e493902e-9bd9-45fc-8052-6573962e7663 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:06.534898 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e493902e-9bd9-45fc-8052-6573962e7663 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:06.660346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e493902e-9bd9-45fc-8052-6573962e7663 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:06.668348 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e493902e-9bd9-45fc-8052-6573962e7663 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1564 microversion: 2.1 time: 0.145699 Jun 06 13:11:06.668912 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 177/344] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:06 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1564 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:06.685314 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a16e49b9-e072-49c2-8c01-52ff0b6fdc15 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:06.685803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a16e49b9-e072-49c2-8c01-52ff0b6fdc15 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:06.691727 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a16e49b9-e072-49c2-8c01-52ff0b6fdc15 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:06.692214 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a16e49b9-e072-49c2-8c01-52ff0b6fdc15 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:06.693073 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a16e49b9-e072-49c2-8c01-52ff0b6fdc15 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:06.693502 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a16e49b9-e072-49c2-8c01-52ff0b6fdc15 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:06.767498 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a16e49b9-e072-49c2-8c01-52ff0b6fdc15 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.085917 Jun 06 13:11:06.768126 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 168/345] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 13:11:06 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-interface => generated 284 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:11:07.054457 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-11479851-7f30-4ef2-a8bc-f2e2cce0304a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:07.055094 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-11479851-7f30-4ef2-a8bc-f2e2cce0304a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:07.056992 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:07.061784 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11479851-7f30-4ef2-a8bc-f2e2cce0304a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:07.062230 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11479851-7f30-4ef2-a8bc-f2e2cce0304a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:07.062993 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11479851-7f30-4ef2-a8bc-f2e2cce0304a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:07.063425 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11479851-7f30-4ef2-a8bc-f2e2cce0304a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:07.252900 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=12 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:07.291507 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-11479851-7f30-4ef2-a8bc-f2e2cce0304a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:07.298833 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:07.299638 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=12 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:07.300032 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-11479851-7f30-4ef2-a8bc-f2e2cce0304a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.249772 Jun 06 13:11:07.300685 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 178/346] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:07 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 251 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:07.303927 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9e389e5c-404a-4e56-acd6-f32f12a3a9f2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:07.304710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9e389e5c-404a-4e56-acd6-f32f12a3a9f2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:07.310920 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9e389e5c-404a-4e56-acd6-f32f12a3a9f2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:07.311369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9e389e5c-404a-4e56-acd6-f32f12a3a9f2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:07.312203 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9e389e5c-404a-4e56-acd6-f32f12a3a9f2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:07.312678 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9e389e5c-404a-4e56-acd6-f32f12a3a9f2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:07.459873 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cef4bdb4-b9d8-4af7-b8e8-570440db39d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:07.460369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cef4bdb4-b9d8-4af7-b8e8-570440db39d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:07.466898 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cef4bdb4-b9d8-4af7-b8e8-570440db39d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:07.467346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cef4bdb4-b9d8-4af7-b8e8-570440db39d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:07.468248 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cef4bdb4-b9d8-4af7-b8e8-570440db39d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:07.468725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cef4bdb4-b9d8-4af7-b8e8-570440db39d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:07.480074 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9e389e5c-404a-4e56-acd6-f32f12a3a9f2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:07.482236 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=100 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:07.488650 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9e389e5c-404a-4e56-acd6-f32f12a3a9f2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:07.490211 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9e389e5c-404a-4e56-acd6-f32f12a3a9f2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:07.491381 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9e389e5c-404a-4e56-acd6-f32f12a3a9f2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.193897 Jun 06 13:11:07.499010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 169/347] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:07 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:11:07.700520 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cef4bdb4-b9d8-4af7-b8e8-570440db39d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:07.707360 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cef4bdb4-b9d8-4af7-b8e8-570440db39d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.253089 Jun 06 13:11:07.707995 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 179/348] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:07 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:11:07.967041 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-c1f9c329-311d-40ca-a1d5-d1f3e31a6482 req-abe2b3dc-7c50-4c6e-a216-fd530534967c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed", "tag": "f0e7842e-73e3-4514-a0b0-f79d3d8a84f2"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:11:07.975567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-c1f9c329-311d-40ca-a1d5-d1f3e31a6482 req-abe2b3dc-7c50-4c6e-a216-fd530534967c service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:07.976009 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-c1f9c329-311d-40ca-a1d5-d1f3e31a6482 req-abe2b3dc-7c50-4c6e-a216-fd530534967c service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:07.988189 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-c1f9c329-311d-40ca-a1d5-d1f3e31a6482 req-abe2b3dc-7c50-4c6e-a216-fd530534967c service nova] Creating event network-changed:f0e7842e-73e3-4514-a0b0-f79d3d8a84f2 for instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed on hv-cinder-75510 Jun 06 13:11:07.993947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-c1f9c329-311d-40ca-a1d5-d1f3e31a6482 req-abe2b3dc-7c50-4c6e-a216-fd530534967c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031038 Jun 06 13:11:07.994611 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 170/349] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:11:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:11:08.316263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-acdf6e69-f8ca-4d4b-afff-b917f0b9090e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:08.316979 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-acdf6e69-f8ca-4d4b-afff-b917f0b9090e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:08.324827 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-acdf6e69-f8ca-4d4b-afff-b917f0b9090e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:08.325355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-acdf6e69-f8ca-4d4b-afff-b917f0b9090e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:08.326197 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-acdf6e69-f8ca-4d4b-afff-b917f0b9090e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:08.326709 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-acdf6e69-f8ca-4d4b-afff-b917f0b9090e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:08.466962 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-acdf6e69-f8ca-4d4b-afff-b917f0b9090e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:08.475645 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-acdf6e69-f8ca-4d4b-afff-b917f0b9090e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.163180 Jun 06 13:11:08.476217 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 180/350] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:08 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:08.518603 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5cadeab0-0f7e-4310-8393-d11bb2ee0f84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:08.519288 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5cadeab0-0f7e-4310-8393-d11bb2ee0f84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:08.525869 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5cadeab0-0f7e-4310-8393-d11bb2ee0f84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:08.526575 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5cadeab0-0f7e-4310-8393-d11bb2ee0f84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:08.527073 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5cadeab0-0f7e-4310-8393-d11bb2ee0f84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:08.527503 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5cadeab0-0f7e-4310-8393-d11bb2ee0f84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:08.672861 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5cadeab0-0f7e-4310-8393-d11bb2ee0f84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:08.682398 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5cadeab0-0f7e-4310-8393-d11bb2ee0f84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:08.683943 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5cadeab0-0f7e-4310-8393-d11bb2ee0f84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:08.685101 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5cadeab0-0f7e-4310-8393-d11bb2ee0f84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.171196 Jun 06 13:11:08.685658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 171/351] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:08 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:08.724393 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1a07e39d-f097-49bf-b6e5-fa53d23f81f3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:08.724916 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1a07e39d-f097-49bf-b6e5-fa53d23f81f3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:08.730835 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1a07e39d-f097-49bf-b6e5-fa53d23f81f3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:08.731270 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1a07e39d-f097-49bf-b6e5-fa53d23f81f3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:08.732050 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1a07e39d-f097-49bf-b6e5-fa53d23f81f3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:08.732467 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1a07e39d-f097-49bf-b6e5-fa53d23f81f3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:08.875218 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1a07e39d-f097-49bf-b6e5-fa53d23f81f3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:08.883034 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1a07e39d-f097-49bf-b6e5-fa53d23f81f3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.162575 Jun 06 13:11:08.884088 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 181/352] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:08 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:09.494320 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1d6c34a3-229b-4508-8b83-b1d90fef9d81 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:09.494855 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1d6c34a3-229b-4508-8b83-b1d90fef9d81 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:09.500984 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1d6c34a3-229b-4508-8b83-b1d90fef9d81 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:09.501433 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1d6c34a3-229b-4508-8b83-b1d90fef9d81 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:09.502196 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1d6c34a3-229b-4508-8b83-b1d90fef9d81 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:09.502631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1d6c34a3-229b-4508-8b83-b1d90fef9d81 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:09.647781 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1d6c34a3-229b-4508-8b83-b1d90fef9d81 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:09.656571 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1d6c34a3-229b-4508-8b83-b1d90fef9d81 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.166145 Jun 06 13:11:09.657714 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 172/353] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:09 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:11:09.704244 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-52d82060-d0cc-4b8f-b081-36b66fb3ff70 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:09.704853 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-52d82060-d0cc-4b8f-b081-36b66fb3ff70 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:09.711986 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52d82060-d0cc-4b8f-b081-36b66fb3ff70 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:09.712427 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52d82060-d0cc-4b8f-b081-36b66fb3ff70 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:09.713184 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52d82060-d0cc-4b8f-b081-36b66fb3ff70 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:09.713613 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52d82060-d0cc-4b8f-b081-36b66fb3ff70 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:09.846459 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-52d82060-d0cc-4b8f-b081-36b66fb3ff70 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:09.857655 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-52d82060-d0cc-4b8f-b081-36b66fb3ff70 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:09.859159 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-52d82060-d0cc-4b8f-b081-36b66fb3ff70 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:09.861628 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-52d82060-d0cc-4b8f-b081-36b66fb3ff70 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.159975 Jun 06 13:11:09.873300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 182/354] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:09 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:09.901406 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6a874c3f-b371-48c6-94dd-c9ec4f4b2385 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:09.902022 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6a874c3f-b371-48c6-94dd-c9ec4f4b2385 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:09.908815 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6a874c3f-b371-48c6-94dd-c9ec4f4b2385 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:09.909266 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6a874c3f-b371-48c6-94dd-c9ec4f4b2385 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:09.910174 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6a874c3f-b371-48c6-94dd-c9ec4f4b2385 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:09.910819 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6a874c3f-b371-48c6-94dd-c9ec4f4b2385 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:10.039247 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6a874c3f-b371-48c6-94dd-c9ec4f4b2385 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:10.047083 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6a874c3f-b371-48c6-94dd-c9ec4f4b2385 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.149827 Jun 06 13:11:10.047686 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 173/355] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:09 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:11:10.674182 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d671a41e-af7c-4bcb-bc6e-2d0ab24345af tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:10.674797 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d671a41e-af7c-4bcb-bc6e-2d0ab24345af tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:10.681972 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d671a41e-af7c-4bcb-bc6e-2d0ab24345af tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:10.682415 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d671a41e-af7c-4bcb-bc6e-2d0ab24345af tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:10.683182 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d671a41e-af7c-4bcb-bc6e-2d0ab24345af tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:10.683644 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d671a41e-af7c-4bcb-bc6e-2d0ab24345af tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:10.699842 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:10.810703 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d671a41e-af7c-4bcb-bc6e-2d0ab24345af tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:10.819327 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d671a41e-af7c-4bcb-bc6e-2d0ab24345af tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.149203 Jun 06 13:11:10.819933 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 183/356] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:10 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:10.878808 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fee2dab0-0c88-4d8e-acfc-72846629af48 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:10.879374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-fee2dab0-0c88-4d8e-acfc-72846629af48 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:10.886691 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fee2dab0-0c88-4d8e-acfc-72846629af48 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:10.887141 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fee2dab0-0c88-4d8e-acfc-72846629af48 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:10.887960 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fee2dab0-0c88-4d8e-acfc-72846629af48 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:10.888396 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fee2dab0-0c88-4d8e-acfc-72846629af48 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:11.018925 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-fee2dab0-0c88-4d8e-acfc-72846629af48 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:11.027608 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-fee2dab0-0c88-4d8e-acfc-72846629af48 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:11.029089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-fee2dab0-0c88-4d8e-acfc-72846629af48 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:11.030324 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-fee2dab0-0c88-4d8e-acfc-72846629af48 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1742 microversion: 2.20 time: 0.155390 Jun 06 13:11:11.030886 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 174/357] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:10 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1742 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:11.064396 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7bb31e4b-28d5-4440-98ee-1ce9913f46dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:11.065003 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7bb31e4b-28d5-4440-98ee-1ce9913f46dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:11.071762 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7bb31e4b-28d5-4440-98ee-1ce9913f46dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:11.072209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7bb31e4b-28d5-4440-98ee-1ce9913f46dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:11.072969 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7bb31e4b-28d5-4440-98ee-1ce9913f46dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:11.073399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7bb31e4b-28d5-4440-98ee-1ce9913f46dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:11.201594 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7bb31e4b-28d5-4440-98ee-1ce9913f46dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:11.209724 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7bb31e4b-28d5-4440-98ee-1ce9913f46dc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.149024 Jun 06 13:11:11.210345 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 184/358] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:11 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:11.835642 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-182b162f-cbe5-4415-b655-9932889f5dd4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:11.836249 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-182b162f-cbe5-4415-b655-9932889f5dd4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:11.842281 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-182b162f-cbe5-4415-b655-9932889f5dd4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:11.842725 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-182b162f-cbe5-4415-b655-9932889f5dd4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:11.843478 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-182b162f-cbe5-4415-b655-9932889f5dd4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:11.843924 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-182b162f-cbe5-4415-b655-9932889f5dd4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:11.974819 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-182b162f-cbe5-4415-b655-9932889f5dd4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:11.983070 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-182b162f-cbe5-4415-b655-9932889f5dd4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.151639 Jun 06 13:11:11.983648 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 175/359] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:11 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:12.047813 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-eeefc14d-539d-485a-9ae2-95b603ff89bd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:12.048416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-eeefc14d-539d-485a-9ae2-95b603ff89bd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:12.055488 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eeefc14d-539d-485a-9ae2-95b603ff89bd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:12.055956 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eeefc14d-539d-485a-9ae2-95b603ff89bd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:12.056747 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eeefc14d-539d-485a-9ae2-95b603ff89bd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:12.057181 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eeefc14d-539d-485a-9ae2-95b603ff89bd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:12.184634 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-eeefc14d-539d-485a-9ae2-95b603ff89bd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:12.192651 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-eeefc14d-539d-485a-9ae2-95b603ff89bd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:12.194492 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-eeefc14d-539d-485a-9ae2-95b603ff89bd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:12.195685 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-eeefc14d-539d-485a-9ae2-95b603ff89bd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1742 microversion: 2.20 time: 0.151758 Jun 06 13:11:12.196248 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 185/360] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:12 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1742 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:12.226907 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-eb466eb4-6fcc-4f2d-b331-288551e61c32 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:12.227465 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-eb466eb4-6fcc-4f2d-b331-288551e61c32 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:12.233620 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-eb466eb4-6fcc-4f2d-b331-288551e61c32 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:12.234060 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-eb466eb4-6fcc-4f2d-b331-288551e61c32 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:12.234814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-eb466eb4-6fcc-4f2d-b331-288551e61c32 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:12.235242 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-eb466eb4-6fcc-4f2d-b331-288551e61c32 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:12.364021 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-eb466eb4-6fcc-4f2d-b331-288551e61c32 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:12.371559 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-eb466eb4-6fcc-4f2d-b331-288551e61c32 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.149307 Jun 06 13:11:12.372225 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 176/361] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:12 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:13.001501 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3ebb689d-f8df-4982-a1c1-868858cb9162 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:13.002040 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3ebb689d-f8df-4982-a1c1-868858cb9162 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:13.008835 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3ebb689d-f8df-4982-a1c1-868858cb9162 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:13.009311 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3ebb689d-f8df-4982-a1c1-868858cb9162 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:13.010082 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3ebb689d-f8df-4982-a1c1-868858cb9162 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:13.010550 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3ebb689d-f8df-4982-a1c1-868858cb9162 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:13.167756 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3ebb689d-f8df-4982-a1c1-868858cb9162 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:13.175964 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3ebb689d-f8df-4982-a1c1-868858cb9162 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.178932 Jun 06 13:11:13.176536 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 186/362] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:12 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:13.216445 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ea82bc13-c4ef-43e9-8992-5e47fc94205c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:13.217292 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ea82bc13-c4ef-43e9-8992-5e47fc94205c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:13.226315 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ea82bc13-c4ef-43e9-8992-5e47fc94205c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:13.226764 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ea82bc13-c4ef-43e9-8992-5e47fc94205c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:13.227765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ea82bc13-c4ef-43e9-8992-5e47fc94205c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:13.228195 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ea82bc13-c4ef-43e9-8992-5e47fc94205c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:13.362425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ea82bc13-c4ef-43e9-8992-5e47fc94205c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:13.370614 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ea82bc13-c4ef-43e9-8992-5e47fc94205c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:13.372354 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ea82bc13-c4ef-43e9-8992-5e47fc94205c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:13.373630 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ea82bc13-c4ef-43e9-8992-5e47fc94205c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1742 microversion: 2.20 time: 0.161850 Jun 06 13:11:13.374284 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 177/363] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:13 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1742 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:13.398942 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2a5460f4-1f86-43b1-8afb-2d643b9701c7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:13.399918 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2a5460f4-1f86-43b1-8afb-2d643b9701c7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:13.408640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2a5460f4-1f86-43b1-8afb-2d643b9701c7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:13.409185 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2a5460f4-1f86-43b1-8afb-2d643b9701c7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:13.410240 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2a5460f4-1f86-43b1-8afb-2d643b9701c7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:13.410822 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2a5460f4-1f86-43b1-8afb-2d643b9701c7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:13.604021 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2a5460f4-1f86-43b1-8afb-2d643b9701c7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:13.612414 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2a5460f4-1f86-43b1-8afb-2d643b9701c7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.219544 Jun 06 13:11:13.615919 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 187/364] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:13 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:13.714055 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-566ea3a2-55f3-4673-8305-3c85f7141d4c req-8be71540-abba-429c-92a4-1727b3630706 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc5ce11-0a01-44fd-9be7-c095a8254551", "name": "network-vif-plugged", "status": "completed", "tag": "5fd26d76-0c93-4177-8c73-21f7779282ef"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:11:13.725903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-566ea3a2-55f3-4673-8305-3c85f7141d4c req-8be71540-abba-429c-92a4-1727b3630706 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:13.726455 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-566ea3a2-55f3-4673-8305-3c85f7141d4c req-8be71540-abba-429c-92a4-1727b3630706 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:13.740428 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-566ea3a2-55f3-4673-8305-3c85f7141d4c req-8be71540-abba-429c-92a4-1727b3630706 service nova] Creating event network-vif-plugged:5fd26d76-0c93-4177-8c73-21f7779282ef for instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 on hv-cinder-75510 Jun 06 13:11:13.745472 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-566ea3a2-55f3-4673-8305-3c85f7141d4c req-8be71540-abba-429c-92a4-1727b3630706 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036847 Jun 06 13:11:13.746241 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 178/365] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:11:14.193272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5819642b-3893-4fab-a2c5-06cf35639d14 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:14.198554 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5819642b-3893-4fab-a2c5-06cf35639d14 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:14.201017 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5819642b-3893-4fab-a2c5-06cf35639d14 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:14.201464 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5819642b-3893-4fab-a2c5-06cf35639d14 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:14.202228 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5819642b-3893-4fab-a2c5-06cf35639d14 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:14.202658 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5819642b-3893-4fab-a2c5-06cf35639d14 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:14.360872 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5819642b-3893-4fab-a2c5-06cf35639d14 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:14.369774 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5819642b-3893-4fab-a2c5-06cf35639d14 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.180077 Jun 06 13:11:14.370631 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 188/366] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:14 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:14.395100 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f8275bcb-4a95-4b0e-b809-c03fc37891db tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:14.396502 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f8275bcb-4a95-4b0e-b809-c03fc37891db tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:14.404983 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f8275bcb-4a95-4b0e-b809-c03fc37891db tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:14.409910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f8275bcb-4a95-4b0e-b809-c03fc37891db tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:14.409910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f8275bcb-4a95-4b0e-b809-c03fc37891db tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:14.409910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f8275bcb-4a95-4b0e-b809-c03fc37891db tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:14.567378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f8275bcb-4a95-4b0e-b809-c03fc37891db tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:14.580597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f8275bcb-4a95-4b0e-b809-c03fc37891db tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:14.582314 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f8275bcb-4a95-4b0e-b809-c03fc37891db tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:14.583614 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f8275bcb-4a95-4b0e-b809-c03fc37891db tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1742 microversion: 2.20 time: 0.192920 Jun 06 13:11:14.584527 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 179/367] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:14 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1742 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:14.642076 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e8ba15b1-a934-40ad-9325-b836b716c650 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:14.642687 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e8ba15b1-a934-40ad-9325-b836b716c650 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:14.649985 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8ba15b1-a934-40ad-9325-b836b716c650 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:14.650904 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8ba15b1-a934-40ad-9325-b836b716c650 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:14.651212 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8ba15b1-a934-40ad-9325-b836b716c650 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:14.651642 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8ba15b1-a934-40ad-9325-b836b716c650 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:14.796005 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e8ba15b1-a934-40ad-9325-b836b716c650 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:14.803691 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e8ba15b1-a934-40ad-9325-b836b716c650 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.166085 Jun 06 13:11:14.804265 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 189/368] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:14 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:15.388321 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0cda1321-6b64-4594-9a45-c8820b0aad70 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:15.388993 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0cda1321-6b64-4594-9a45-c8820b0aad70 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:15.395154 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0cda1321-6b64-4594-9a45-c8820b0aad70 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:15.395781 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0cda1321-6b64-4594-9a45-c8820b0aad70 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:15.396447 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0cda1321-6b64-4594-9a45-c8820b0aad70 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:15.397134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0cda1321-6b64-4594-9a45-c8820b0aad70 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:15.567510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-0cda1321-6b64-4594-9a45-c8820b0aad70 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:15.602153 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0cda1321-6b64-4594-9a45-c8820b0aad70 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.217571 Jun 06 13:11:15.603260 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b024a319-a8ef-4913-86de-161b9c2fe4ad tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:15.603923 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b024a319-a8ef-4913-86de-161b9c2fe4ad tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:15.605371 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 180/369] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:15 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:15.614297 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b024a319-a8ef-4913-86de-161b9c2fe4ad tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:15.617990 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b024a319-a8ef-4913-86de-161b9c2fe4ad tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:15.619097 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b024a319-a8ef-4913-86de-161b9c2fe4ad tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:15.620697 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b024a319-a8ef-4913-86de-161b9c2fe4ad tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:15.776054 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-0ad3f816-63af-444a-84cd-a6ae64df0d82 req-8235ad72-1c4d-4e94-bd9d-09e7810ecf4a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02dfda62-0a51-417a-807a-c653d5fc26db", "name": "network-vif-plugged", "status": "completed", "tag": "8c71242d-a06b-44fd-b334-7c6b540ac882"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:11:15.790806 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-0ad3f816-63af-444a-84cd-a6ae64df0d82 req-8235ad72-1c4d-4e94-bd9d-09e7810ecf4a service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:15.791117 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-0ad3f816-63af-444a-84cd-a6ae64df0d82 req-8235ad72-1c4d-4e94-bd9d-09e7810ecf4a service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:15.817760 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-0ad3f816-63af-444a-84cd-a6ae64df0d82 req-8235ad72-1c4d-4e94-bd9d-09e7810ecf4a service nova] Creating event network-vif-plugged:8c71242d-a06b-44fd-b334-7c6b540ac882 for instance 02dfda62-0a51-417a-807a-c653d5fc26db on hv-cinder-75510 Jun 06 13:11:15.829829 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-0ad3f816-63af-444a-84cd-a6ae64df0d82 req-8235ad72-1c4d-4e94-bd9d-09e7810ecf4a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058847 Jun 06 13:11:15.830444 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 181/370] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:11:15.847118 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-38354469-caf8-4a20-895f-f8fc01ee80a5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:15.847901 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-38354469-caf8-4a20-895f-f8fc01ee80a5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:15.861774 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38354469-caf8-4a20-895f-f8fc01ee80a5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:15.862181 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38354469-caf8-4a20-895f-f8fc01ee80a5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:15.862967 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38354469-caf8-4a20-895f-f8fc01ee80a5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:15.863411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38354469-caf8-4a20-895f-f8fc01ee80a5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:16.296118 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b024a319-a8ef-4913-86de-161b9c2fe4ad tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:16.306108 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b024a319-a8ef-4913-86de-161b9c2fe4ad tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:16.307907 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b024a319-a8ef-4913-86de-161b9c2fe4ad tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:16.309827 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b024a319-a8ef-4913-86de-161b9c2fe4ad tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1737 microversion: 2.20 time: 0.711461 Jun 06 13:11:16.311044 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 190/371] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:15 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1737 bytes in 713 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:11:16.324455 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-38354469-caf8-4a20-895f-f8fc01ee80a5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:16.332633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-38354469-caf8-4a20-895f-f8fc01ee80a5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.500999 Jun 06 13:11:16.333453 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 182/372] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:15 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:16.622107 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-82c5f74c-a780-42f2-9097-724c034cf993 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:16.623435 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-82c5f74c-a780-42f2-9097-724c034cf993 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:16.631022 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82c5f74c-a780-42f2-9097-724c034cf993 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:16.635662 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82c5f74c-a780-42f2-9097-724c034cf993 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:16.635662 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82c5f74c-a780-42f2-9097-724c034cf993 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:16.635662 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82c5f74c-a780-42f2-9097-724c034cf993 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:16.797526 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-82c5f74c-a780-42f2-9097-724c034cf993 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:16.812470 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-82c5f74c-a780-42f2-9097-724c034cf993 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.194288 Jun 06 13:11:16.813669 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 191/373] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:16 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:17.227461 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bf2ae1d6-3f61-4116-9743-b44327d8c71c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "4d51fbb9-8dd6-43e2-8613-d636054f8842", "device": "/dev/sdb"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:11:17.230058 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-bf2ae1d6-3f61-4116-9743-b44327d8c71c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:17.238433 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bf2ae1d6-3f61-4116-9743-b44327d8c71c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:17.239255 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bf2ae1d6-3f61-4116-9743-b44327d8c71c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:17.240642 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bf2ae1d6-3f61-4116-9743-b44327d8c71c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:17.241545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bf2ae1d6-3f61-4116-9743-b44327d8c71c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:17.336820 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ce1bd404-b7c8-4b36-a824-0e26ee3c4c82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:17.337925 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ce1bd404-b7c8-4b36-a824-0e26ee3c4c82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:17.346858 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce1bd404-b7c8-4b36-a824-0e26ee3c4c82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:17.348114 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce1bd404-b7c8-4b36-a824-0e26ee3c4c82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:17.348886 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce1bd404-b7c8-4b36-a824-0e26ee3c4c82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:17.349364 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce1bd404-b7c8-4b36-a824-0e26ee3c4c82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:17.506343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ce1bd404-b7c8-4b36-a824-0e26ee3c4c82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:17.516663 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ce1bd404-b7c8-4b36-a824-0e26ee3c4c82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:17.518175 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ce1bd404-b7c8-4b36-a824-0e26ee3c4c82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:17.519339 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ce1bd404-b7c8-4b36-a824-0e26ee3c4c82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1737 microversion: 2.20 time: 0.191202 Jun 06 13:11:17.531481 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 192/374] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:17 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:11:17.536535 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fa8d8e55-fea0-4dcb-a2b7-9101212d92f2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:17.537625 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fa8d8e55-fea0-4dcb-a2b7-9101212d92f2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:17.544066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa8d8e55-fea0-4dcb-a2b7-9101212d92f2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:17.544506 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa8d8e55-fea0-4dcb-a2b7-9101212d92f2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:17.545267 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa8d8e55-fea0-4dcb-a2b7-9101212d92f2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:17.545694 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa8d8e55-fea0-4dcb-a2b7-9101212d92f2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:17.702608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fa8d8e55-fea0-4dcb-a2b7-9101212d92f2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:17.705641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fa8d8e55-fea0-4dcb-a2b7-9101212d92f2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.172914 Jun 06 13:11:17.706215 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 193/375] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:17 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:17.833594 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8674d0d1-b286-4aa5-9e2c-975946c8ab02 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:17.835653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8674d0d1-b286-4aa5-9e2c-975946c8ab02 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:17.844273 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8674d0d1-b286-4aa5-9e2c-975946c8ab02 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:17.844809 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8674d0d1-b286-4aa5-9e2c-975946c8ab02 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:17.845942 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8674d0d1-b286-4aa5-9e2c-975946c8ab02 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:17.846590 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8674d0d1-b286-4aa5-9e2c-975946c8ab02 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:18.014735 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8674d0d1-b286-4aa5-9e2c-975946c8ab02 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:18.027927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8674d0d1-b286-4aa5-9e2c-975946c8ab02 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.198029 Jun 06 13:11:18.028943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 194/376] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:17 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:11:18.540715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1975afb7-9b35-4f72-aeda-97a751d010d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:18.541602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1975afb7-9b35-4f72-aeda-97a751d010d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:18.548609 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1975afb7-9b35-4f72-aeda-97a751d010d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:18.549114 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1975afb7-9b35-4f72-aeda-97a751d010d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:18.550018 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1975afb7-9b35-4f72-aeda-97a751d010d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:18.550446 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1975afb7-9b35-4f72-aeda-97a751d010d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:18.705928 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1975afb7-9b35-4f72-aeda-97a751d010d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:18.715063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1975afb7-9b35-4f72-aeda-97a751d010d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:18.716894 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1975afb7-9b35-4f72-aeda-97a751d010d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:18.718307 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1975afb7-9b35-4f72-aeda-97a751d010d2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1737 microversion: 2.20 time: 0.182074 Jun 06 13:11:18.719308 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 195/377] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:18 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1737 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:11:18.725524 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-89773863-65ef-4e17-aef6-ac0a9a508a9d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:18.726196 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-89773863-65ef-4e17-aef6-ac0a9a508a9d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:18.735165 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89773863-65ef-4e17-aef6-ac0a9a508a9d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:18.735638 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89773863-65ef-4e17-aef6-ac0a9a508a9d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:18.736441 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89773863-65ef-4e17-aef6-ac0a9a508a9d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:18.736929 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89773863-65ef-4e17-aef6-ac0a9a508a9d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:18.875284 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-89773863-65ef-4e17-aef6-ac0a9a508a9d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:18.882965 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-89773863-65ef-4e17-aef6-ac0a9a508a9d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.162585 Jun 06 13:11:18.883543 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 196/378] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:18 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:19.046210 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3686d883-382a-44c7-8e11-1c98f76899b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:19.046841 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3686d883-382a-44c7-8e11-1c98f76899b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:19.056272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3686d883-382a-44c7-8e11-1c98f76899b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:19.056272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3686d883-382a-44c7-8e11-1c98f76899b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:19.056272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3686d883-382a-44c7-8e11-1c98f76899b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:19.056272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3686d883-382a-44c7-8e11-1c98f76899b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:19.195659 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3686d883-382a-44c7-8e11-1c98f76899b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:19.212036 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3686d883-382a-44c7-8e11-1c98f76899b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.167065 Jun 06 13:11:19.226258 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 197/379] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:19 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:19.737405 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-46a23bc0-b4dd-448a-860f-3beec0044e4a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:19.738781 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-46a23bc0-b4dd-448a-860f-3beec0044e4a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:19.745799 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46a23bc0-b4dd-448a-860f-3beec0044e4a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:19.746231 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46a23bc0-b4dd-448a-860f-3beec0044e4a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:19.746997 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46a23bc0-b4dd-448a-860f-3beec0044e4a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:19.747651 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46a23bc0-b4dd-448a-860f-3beec0044e4a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:19.899083 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-46a23bc0-b4dd-448a-860f-3beec0044e4a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:19.908302 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-46a23bc0-b4dd-448a-860f-3beec0044e4a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:19.911359 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-46a23bc0-b4dd-448a-860f-3beec0044e4a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:19.913192 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-46a23bc0-b4dd-448a-860f-3beec0044e4a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1737 microversion: 2.20 time: 0.179815 Jun 06 13:11:19.913773 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 198/380] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:19 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1737 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:19.928989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1855ca2d-39d3-4746-b1d0-e2f132cd8d64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:19.929591 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1855ca2d-39d3-4746-b1d0-e2f132cd8d64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:19.936058 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1855ca2d-39d3-4746-b1d0-e2f132cd8d64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:19.936501 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1855ca2d-39d3-4746-b1d0-e2f132cd8d64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:19.937258 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1855ca2d-39d3-4746-b1d0-e2f132cd8d64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:19.937676 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1855ca2d-39d3-4746-b1d0-e2f132cd8d64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:20.095321 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1855ca2d-39d3-4746-b1d0-e2f132cd8d64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:20.105610 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1855ca2d-39d3-4746-b1d0-e2f132cd8d64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.180385 Jun 06 13:11:20.111959 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 199/381] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:19 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:20.232810 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-04b00ffd-d3bf-4c06-8c27-74460118763d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:20.233459 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-04b00ffd-d3bf-4c06-8c27-74460118763d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:20.240240 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-04b00ffd-d3bf-4c06-8c27-74460118763d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:20.241661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-04b00ffd-d3bf-4c06-8c27-74460118763d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:20.241772 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-04b00ffd-d3bf-4c06-8c27-74460118763d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:20.242183 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-04b00ffd-d3bf-4c06-8c27-74460118763d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:20.244914 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:20.393653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-04b00ffd-d3bf-4c06-8c27-74460118763d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:20.403903 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-04b00ffd-d3bf-4c06-8c27-74460118763d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.175259 Jun 06 13:11:20.414174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 200/382] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:20 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:11:20.932211 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d0c2596a-61d7-4b24-8ab9-059e33b348d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:20.933621 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d0c2596a-61d7-4b24-8ab9-059e33b348d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:20.940510 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0c2596a-61d7-4b24-8ab9-059e33b348d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:20.941176 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0c2596a-61d7-4b24-8ab9-059e33b348d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:20.942333 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0c2596a-61d7-4b24-8ab9-059e33b348d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:20.942765 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0c2596a-61d7-4b24-8ab9-059e33b348d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:21.110338 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-bf2ae1d6-3f61-4116-9743-b44327d8c71c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "POST /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.888299 Jun 06 13:11:21.112868 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0c2596a-61d7-4b24-8ab9-059e33b348d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:21.124179 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0c2596a-61d7-4b24-8ab9-059e33b348d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:21.126135 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0c2596a-61d7-4b24-8ab9-059e33b348d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:21.129758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 183/383] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:11:17 2022] POST /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e/os-volume_attachments => generated 194 bytes in 3907 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:11:21.132138 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d0c2596a-61d7-4b24-8ab9-059e33b348d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1737 microversion: 2.20 time: 0.201912 Jun 06 13:11:21.136053 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 201/384] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:20 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1737 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:11:21.161397 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c741f9f7-0794-4e9a-a6b8-da6b5363ab80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:21.165768 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c741f9f7-0794-4e9a-a6b8-da6b5363ab80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:21.181846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c741f9f7-0794-4e9a-a6b8-da6b5363ab80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:21.182613 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c741f9f7-0794-4e9a-a6b8-da6b5363ab80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:21.185859 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c741f9f7-0794-4e9a-a6b8-da6b5363ab80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:21.186651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c741f9f7-0794-4e9a-a6b8-da6b5363ab80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:21.360011 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c741f9f7-0794-4e9a-a6b8-da6b5363ab80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:21.369528 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c741f9f7-0794-4e9a-a6b8-da6b5363ab80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1366 microversion: 2.1 time: 0.238111 Jun 06 13:11:21.370197 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 184/385] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:21 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1366 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:21.420406 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-df7e72ea-5000-48b6-bcd3-ffcc2328a72d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:21.421007 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-df7e72ea-5000-48b6-bcd3-ffcc2328a72d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:21.429027 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df7e72ea-5000-48b6-bcd3-ffcc2328a72d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:21.429565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df7e72ea-5000-48b6-bcd3-ffcc2328a72d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:21.430138 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df7e72ea-5000-48b6-bcd3-ffcc2328a72d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:21.430739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df7e72ea-5000-48b6-bcd3-ffcc2328a72d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:21.593026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-df7e72ea-5000-48b6-bcd3-ffcc2328a72d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:21.602943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-df7e72ea-5000-48b6-bcd3-ffcc2328a72d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.185787 Jun 06 13:11:21.603866 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 202/386] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:21 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:22.156780 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f32eee00-95f2-4ad4-88b0-5fdfba1b4537 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:22.157610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f32eee00-95f2-4ad4-88b0-5fdfba1b4537 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:22.160582 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=83,nova_api:INSERT=3 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:22.168216 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f32eee00-95f2-4ad4-88b0-5fdfba1b4537 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:22.168925 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f32eee00-95f2-4ad4-88b0-5fdfba1b4537 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:22.169955 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f32eee00-95f2-4ad4-88b0-5fdfba1b4537 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:22.170480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f32eee00-95f2-4ad4-88b0-5fdfba1b4537 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:22.322628 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f32eee00-95f2-4ad4-88b0-5fdfba1b4537 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:22.330641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f32eee00-95f2-4ad4-88b0-5fdfba1b4537 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:22.332193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f32eee00-95f2-4ad4-88b0-5fdfba1b4537 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:22.333334 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f32eee00-95f2-4ad4-88b0-5fdfba1b4537 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1737 microversion: 2.20 time: 0.183979 Jun 06 13:11:22.334053 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 185/387] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:22 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1737 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:22.386447 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-aa65bf15-28eb-4bf3-b3d6-aa9b5de61cf2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:22.387045 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-aa65bf15-28eb-4bf3-b3d6-aa9b5de61cf2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:22.393826 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa65bf15-28eb-4bf3-b3d6-aa9b5de61cf2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:22.394271 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa65bf15-28eb-4bf3-b3d6-aa9b5de61cf2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:22.395052 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa65bf15-28eb-4bf3-b3d6-aa9b5de61cf2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:22.395497 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa65bf15-28eb-4bf3-b3d6-aa9b5de61cf2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:22.536754 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-aa65bf15-28eb-4bf3-b3d6-aa9b5de61cf2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:22.544838 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-aa65bf15-28eb-4bf3-b3d6-aa9b5de61cf2 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1556 microversion: 2.1 time: 0.162418 Jun 06 13:11:22.545407 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 203/388] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:22 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1556 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:22.561896 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cf776dbe-bbed-402e-893e-226b9351cce5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:22.562383 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-cf776dbe-bbed-402e-893e-226b9351cce5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:22.569212 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cf776dbe-bbed-402e-893e-226b9351cce5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:22.574612 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cf776dbe-bbed-402e-893e-226b9351cce5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:22.574612 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cf776dbe-bbed-402e-893e-226b9351cce5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:22.574612 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cf776dbe-bbed-402e-893e-226b9351cce5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:22.622847 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fc87c59b-57ff-45a0-b24f-054e202c3ccb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:22.623515 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fc87c59b-57ff-45a0-b24f-054e202c3ccb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:22.629787 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fc87c59b-57ff-45a0-b24f-054e202c3ccb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:22.630226 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fc87c59b-57ff-45a0-b24f-054e202c3ccb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:22.631798 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fc87c59b-57ff-45a0-b24f-054e202c3ccb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:22.632423 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fc87c59b-57ff-45a0-b24f-054e202c3ccb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:22.658826 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cf776dbe-bbed-402e-893e-226b9351cce5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.100636 Jun 06 13:11:22.659417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 186/389] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 13:11:22 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db/os-interface => generated 284 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:11:22.847815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fc87c59b-57ff-45a0-b24f-054e202c3ccb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:22.863325 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fc87c59b-57ff-45a0-b24f-054e202c3ccb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.244448 Jun 06 13:11:22.863932 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 204/390] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:22 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:11:23.362825 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e3a55ed5-cb64-48ac-bc93-b3fff1da0222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:23.364251 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e3a55ed5-cb64-48ac-bc93-b3fff1da0222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:23.374515 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e3a55ed5-cb64-48ac-bc93-b3fff1da0222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:23.375232 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e3a55ed5-cb64-48ac-bc93-b3fff1da0222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:23.376229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e3a55ed5-cb64-48ac-bc93-b3fff1da0222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:23.376935 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e3a55ed5-cb64-48ac-bc93-b3fff1da0222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:23.399119 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:23.683848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e3a55ed5-cb64-48ac-bc93-b3fff1da0222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:23.701018 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e3a55ed5-cb64-48ac-bc93-b3fff1da0222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:23.705562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e3a55ed5-cb64-48ac-bc93-b3fff1da0222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:23.711665 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e3a55ed5-cb64-48ac-bc93-b3fff1da0222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1737 microversion: 2.20 time: 0.352435 Jun 06 13:11:23.713587 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 187/391] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:23 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1737 bytes in 357 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:23.881658 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-25a5c7e5-3fb5-4522-aabb-df6cbd52d5c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:23.888830 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-25a5c7e5-3fb5-4522-aabb-df6cbd52d5c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:23.891515 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-25a5c7e5-3fb5-4522-aabb-df6cbd52d5c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:23.894205 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-25a5c7e5-3fb5-4522-aabb-df6cbd52d5c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:23.895386 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-25a5c7e5-3fb5-4522-aabb-df6cbd52d5c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:23.900783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-25a5c7e5-3fb5-4522-aabb-df6cbd52d5c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:24.166038 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-25a5c7e5-3fb5-4522-aabb-df6cbd52d5c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:24.174571 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-25a5c7e5-3fb5-4522-aabb-df6cbd52d5c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.297441 Jun 06 13:11:24.180487 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 205/392] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:23 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:24.296460 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-51054829-7d4c-4340-b55d-472d34713fab req-ccab8b9a-0041-4547-b10b-02766798b618 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "02dfda62-0a51-417a-807a-c653d5fc26db", "tag": "8c71242d-a06b-44fd-b334-7c6b540ac882"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:11:24.310884 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-51054829-7d4c-4340-b55d-472d34713fab req-ccab8b9a-0041-4547-b10b-02766798b618 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:24.312181 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-51054829-7d4c-4340-b55d-472d34713fab req-ccab8b9a-0041-4547-b10b-02766798b618 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:24.331060 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-51054829-7d4c-4340-b55d-472d34713fab req-ccab8b9a-0041-4547-b10b-02766798b618 service nova] Creating event network-changed:8c71242d-a06b-44fd-b334-7c6b540ac882 for instance 02dfda62-0a51-417a-807a-c653d5fc26db on hv-cinder-75510 Jun 06 13:11:24.339729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-51054829-7d4c-4340-b55d-472d34713fab req-ccab8b9a-0041-4547-b10b-02766798b618 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046350 Jun 06 13:11:24.341329 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 188/393] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:11:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:11:24.734406 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-98f99c84-71d8-458c-bfd0-7803c4ca86a6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:24.735207 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-98f99c84-71d8-458c-bfd0-7803c4ca86a6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:24.746220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-98f99c84-71d8-458c-bfd0-7803c4ca86a6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:24.753347 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-98f99c84-71d8-458c-bfd0-7803c4ca86a6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:24.753347 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-98f99c84-71d8-458c-bfd0-7803c4ca86a6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:24.753347 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-98f99c84-71d8-458c-bfd0-7803c4ca86a6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:25.040727 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-98f99c84-71d8-458c-bfd0-7803c4ca86a6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:25.055571 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-98f99c84-71d8-458c-bfd0-7803c4ca86a6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:25.058564 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-98f99c84-71d8-458c-bfd0-7803c4ca86a6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:25.063864 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-98f99c84-71d8-458c-bfd0-7803c4ca86a6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1737 microversion: 2.20 time: 0.334934 Jun 06 13:11:25.065023 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 206/394] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:24 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1737 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:25.195822 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b021e64b-6d26-408b-a456-f2cd5e35f832 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:25.197710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b021e64b-6d26-408b-a456-f2cd5e35f832 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:25.209321 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b021e64b-6d26-408b-a456-f2cd5e35f832 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:25.231934 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b021e64b-6d26-408b-a456-f2cd5e35f832 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:25.242316 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b021e64b-6d26-408b-a456-f2cd5e35f832 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.010s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:25.242996 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b021e64b-6d26-408b-a456-f2cd5e35f832 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:25.415365 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b021e64b-6d26-408b-a456-f2cd5e35f832 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:25.426031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b021e64b-6d26-408b-a456-f2cd5e35f832 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1725 microversion: 2.1 time: 0.236449 Jun 06 13:11:25.430687 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 189/395] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:25 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1725 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:26.083409 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b36403f3-a9a6-4947-a908-4973b497738a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:26.085675 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b36403f3-a9a6-4947-a908-4973b497738a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:26.100476 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b36403f3-a9a6-4947-a908-4973b497738a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:26.102026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b36403f3-a9a6-4947-a908-4973b497738a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:26.115866 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b36403f3-a9a6-4947-a908-4973b497738a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:26.118176 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b36403f3-a9a6-4947-a908-4973b497738a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:26.421042 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b36403f3-a9a6-4947-a908-4973b497738a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:26.434081 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b36403f3-a9a6-4947-a908-4973b497738a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:26.437180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b36403f3-a9a6-4947-a908-4973b497738a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:26.438700 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b36403f3-a9a6-4947-a908-4973b497738a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1737 microversion: 2.20 time: 0.360365 Jun 06 13:11:26.439864 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 207/396] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:26 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1737 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:26.450785 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9608fad5-6e51-4851-91c1-fd75fd95acc6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:26.452080 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9608fad5-6e51-4851-91c1-fd75fd95acc6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:26.466269 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9608fad5-6e51-4851-91c1-fd75fd95acc6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:26.466912 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9608fad5-6e51-4851-91c1-fd75fd95acc6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:26.469983 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9608fad5-6e51-4851-91c1-fd75fd95acc6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:26.470692 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9608fad5-6e51-4851-91c1-fd75fd95acc6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:26.707750 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9608fad5-6e51-4851-91c1-fd75fd95acc6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:26.719059 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9608fad5-6e51-4851-91c1-fd75fd95acc6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1702 microversion: 2.1 time: 0.272077 Jun 06 13:11:26.719979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 190/397] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:26 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1702 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:26.740047 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d2904c44-2ad8-434d-b8e9-0ca8cf1e7001 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:11:26.749494 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d2904c44-2ad8-434d-b8e9-0ca8cf1e7001 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:26.749939 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d2904c44-2ad8-434d-b8e9-0ca8cf1e7001 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:26.801643 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d2904c44-2ad8-434d-b8e9-0ca8cf1e7001 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Going to try to start instance {{(pid=118133) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 06 13:11:27.005501 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d2904c44-2ad8-434d-b8e9-0ca8cf1e7001 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "POST /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/action" status: 202 len: 0 microversion: 2.1 time: 0.270678 Jun 06 13:11:27.007084 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 208/398] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:11:26 2022] POST /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/action => generated 0 bytes in 273 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:11:27.017197 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1048ee5a-c511-4409-ad89-1a6a2a7f94ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:27.020014 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1048ee5a-c511-4409-ad89-1a6a2a7f94ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:27.027418 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1048ee5a-c511-4409-ad89-1a6a2a7f94ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:27.028165 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1048ee5a-c511-4409-ad89-1a6a2a7f94ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:27.029429 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1048ee5a-c511-4409-ad89-1a6a2a7f94ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:27.030185 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1048ee5a-c511-4409-ad89-1a6a2a7f94ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:27.204976 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1048ee5a-c511-4409-ad89-1a6a2a7f94ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:27.213484 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1048ee5a-c511-4409-ad89-1a6a2a7f94ad tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1711 microversion: 2.1 time: 0.200249 Jun 06 13:11:27.214066 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 191/399] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:27 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1711 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:27.458939 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9f32bb9d-bb95-47a7-8a48-c3f9404b4948 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:27.459666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9f32bb9d-bb95-47a7-8a48-c3f9404b4948 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:27.466529 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f32bb9d-bb95-47a7-8a48-c3f9404b4948 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:27.466974 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f32bb9d-bb95-47a7-8a48-c3f9404b4948 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:27.467764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f32bb9d-bb95-47a7-8a48-c3f9404b4948 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:27.468191 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f32bb9d-bb95-47a7-8a48-c3f9404b4948 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:27.607997 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9f32bb9d-bb95-47a7-8a48-c3f9404b4948 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:27.616563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9f32bb9d-bb95-47a7-8a48-c3f9404b4948 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:27.618157 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9f32bb9d-bb95-47a7-8a48-c3f9404b4948 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:27.619373 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9f32bb9d-bb95-47a7-8a48-c3f9404b4948 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1737 microversion: 2.20 time: 0.164844 Jun 06 13:11:27.620035 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 209/400] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:27 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1737 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:28.233435 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b109120a-e4f5-45dc-bfd1-fd4a077ebfc2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:28.234090 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b109120a-e4f5-45dc-bfd1-fd4a077ebfc2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:28.241786 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b109120a-e4f5-45dc-bfd1-fd4a077ebfc2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:28.242491 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b109120a-e4f5-45dc-bfd1-fd4a077ebfc2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:28.243348 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b109120a-e4f5-45dc-bfd1-fd4a077ebfc2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:28.243858 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b109120a-e4f5-45dc-bfd1-fd4a077ebfc2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:28.385881 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b109120a-e4f5-45dc-bfd1-fd4a077ebfc2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:28.394856 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b109120a-e4f5-45dc-bfd1-fd4a077ebfc2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1711 microversion: 2.1 time: 0.165206 Jun 06 13:11:28.403520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 192/401] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:28 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1711 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:28.637685 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-79efd318-6d25-4bf4-8990-431eefeafa93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:28.638418 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-79efd318-6d25-4bf4-8990-431eefeafa93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:28.645034 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79efd318-6d25-4bf4-8990-431eefeafa93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:28.645521 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79efd318-6d25-4bf4-8990-431eefeafa93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:28.646282 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79efd318-6d25-4bf4-8990-431eefeafa93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:28.646707 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79efd318-6d25-4bf4-8990-431eefeafa93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:28.784220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-79efd318-6d25-4bf4-8990-431eefeafa93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:28.792965 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-79efd318-6d25-4bf4-8990-431eefeafa93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:28.794593 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-79efd318-6d25-4bf4-8990-431eefeafa93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:28.800432 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-79efd318-6d25-4bf4-8990-431eefeafa93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1737 microversion: 2.20 time: 0.161950 Jun 06 13:11:28.800432 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 210/402] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:28 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1737 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:29.412613 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-67ccf300-ea89-4f85-83df-8ae36e69f26b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:29.413882 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-67ccf300-ea89-4f85-83df-8ae36e69f26b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:29.420237 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67ccf300-ea89-4f85-83df-8ae36e69f26b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:29.420678 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67ccf300-ea89-4f85-83df-8ae36e69f26b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:29.421437 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67ccf300-ea89-4f85-83df-8ae36e69f26b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:29.421864 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67ccf300-ea89-4f85-83df-8ae36e69f26b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:29.559428 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-67ccf300-ea89-4f85-83df-8ae36e69f26b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:29.567781 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-67ccf300-ea89-4f85-83df-8ae36e69f26b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1715 microversion: 2.1 time: 0.158955 Jun 06 13:11:29.568345 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 193/403] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:11:29 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1715 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:11:29.816134 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3e1949c2-7717-4bfb-9dc7-3bcdfbce3565 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:29.816937 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3e1949c2-7717-4bfb-9dc7-3bcdfbce3565 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:29.824183 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e1949c2-7717-4bfb-9dc7-3bcdfbce3565 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:29.824625 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e1949c2-7717-4bfb-9dc7-3bcdfbce3565 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:29.825391 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e1949c2-7717-4bfb-9dc7-3bcdfbce3565 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:29.825817 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e1949c2-7717-4bfb-9dc7-3bcdfbce3565 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:29.957177 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3e1949c2-7717-4bfb-9dc7-3bcdfbce3565 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:29.966738 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3e1949c2-7717-4bfb-9dc7-3bcdfbce3565 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:29.968278 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3e1949c2-7717-4bfb-9dc7-3bcdfbce3565 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:29.969433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3e1949c2-7717-4bfb-9dc7-3bcdfbce3565 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1737 microversion: 2.20 time: 0.157240 Jun 06 13:11:29.970035 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 211/404] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:29 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1737 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:30.988848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e45f857b-0825-4520-befc-f65105f31b84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:30.989684 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e45f857b-0825-4520-befc-f65105f31b84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:30.997093 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e45f857b-0825-4520-befc-f65105f31b84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:30.997284 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e45f857b-0825-4520-befc-f65105f31b84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:30.998056 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e45f857b-0825-4520-befc-f65105f31b84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:30.998481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e45f857b-0825-4520-befc-f65105f31b84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:31.192395 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e45f857b-0825-4520-befc-f65105f31b84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:31.203000 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e45f857b-0825-4520-befc-f65105f31b84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:31.204600 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e45f857b-0825-4520-befc-f65105f31b84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:31.208962 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e45f857b-0825-4520-befc-f65105f31b84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1719 microversion: 2.20 time: 0.221746 Jun 06 13:11:31.208962 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 194/405] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:30 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1719 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:11:32.224785 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ac1b12db-33ed-4066-b183-034aef64d5a8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:32.226181 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ac1b12db-33ed-4066-b183-034aef64d5a8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:32.233236 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ac1b12db-33ed-4066-b183-034aef64d5a8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:32.233768 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ac1b12db-33ed-4066-b183-034aef64d5a8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:32.235443 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ac1b12db-33ed-4066-b183-034aef64d5a8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:32.235443 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ac1b12db-33ed-4066-b183-034aef64d5a8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:32.371252 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ac1b12db-33ed-4066-b183-034aef64d5a8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:32.379425 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ac1b12db-33ed-4066-b183-034aef64d5a8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:32.380962 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ac1b12db-33ed-4066-b183-034aef64d5a8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:32.382208 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ac1b12db-33ed-4066-b183-034aef64d5a8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1719 microversion: 2.20 time: 0.161438 Jun 06 13:11:32.382777 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 212/406] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:32 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1719 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:33.400592 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-58194e29-49d8-4924-ab1b-1bb3b2b63950 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:33.401198 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-58194e29-49d8-4924-ab1b-1bb3b2b63950 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:33.407789 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-58194e29-49d8-4924-ab1b-1bb3b2b63950 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:33.408233 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-58194e29-49d8-4924-ab1b-1bb3b2b63950 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:33.408993 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-58194e29-49d8-4924-ab1b-1bb3b2b63950 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:33.409428 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-58194e29-49d8-4924-ab1b-1bb3b2b63950 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:33.544467 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-58194e29-49d8-4924-ab1b-1bb3b2b63950 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:33.552287 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-58194e29-49d8-4924-ab1b-1bb3b2b63950 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:33.553794 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-58194e29-49d8-4924-ab1b-1bb3b2b63950 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:33.555854 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-58194e29-49d8-4924-ab1b-1bb3b2b63950 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1719 microversion: 2.20 time: 0.159439 Jun 06 13:11:33.556400 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 195/407] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:33 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1719 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:34.497866 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-93419bfa-fc2a-48d8-a31a-0247af833ee1 req-d046fd56-0a64-4c9a-8942-f6770473fabf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc5ce11-0a01-44fd-9be7-c095a8254551", "name": "network-vif-unplugged", "status": "completed", "tag": "5fd26d76-0c93-4177-8c73-21f7779282ef"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:11:34.506799 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-93419bfa-fc2a-48d8-a31a-0247af833ee1 req-d046fd56-0a64-4c9a-8942-f6770473fabf service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:34.508568 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-93419bfa-fc2a-48d8-a31a-0247af833ee1 req-d046fd56-0a64-4c9a-8942-f6770473fabf service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:34.519622 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-93419bfa-fc2a-48d8-a31a-0247af833ee1 req-d046fd56-0a64-4c9a-8942-f6770473fabf service nova] Creating event network-vif-unplugged:5fd26d76-0c93-4177-8c73-21f7779282ef for instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 on hv-cinder-75510 Jun 06 13:11:34.526270 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-93419bfa-fc2a-48d8-a31a-0247af833ee1 req-d046fd56-0a64-4c9a-8942-f6770473fabf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.032161 Jun 06 13:11:34.526925 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 213/408] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:11:34 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:11:34.574343 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-93361186-0ba1-450e-8bdb-241b697ee82b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:34.574949 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-93361186-0ba1-450e-8bdb-241b697ee82b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:34.581402 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-93361186-0ba1-450e-8bdb-241b697ee82b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:34.581892 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-93361186-0ba1-450e-8bdb-241b697ee82b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:34.582644 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-93361186-0ba1-450e-8bdb-241b697ee82b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:34.583076 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-93361186-0ba1-450e-8bdb-241b697ee82b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:34.713440 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-93361186-0ba1-450e-8bdb-241b697ee82b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:34.721577 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-93361186-0ba1-450e-8bdb-241b697ee82b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:34.723042 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-93361186-0ba1-450e-8bdb-241b697ee82b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:34.724219 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-93361186-0ba1-450e-8bdb-241b697ee82b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1719 microversion: 2.20 time: 0.154493 Jun 06 13:11:34.724858 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 196/409] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:34 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:11:35.744024 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-df50d2b2-f194-4f14-b911-5193c0469418 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:35.744625 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-df50d2b2-f194-4f14-b911-5193c0469418 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:35.750765 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df50d2b2-f194-4f14-b911-5193c0469418 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:35.751201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df50d2b2-f194-4f14-b911-5193c0469418 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:35.751985 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df50d2b2-f194-4f14-b911-5193c0469418 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:35.752410 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-df50d2b2-f194-4f14-b911-5193c0469418 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:35.881691 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-df50d2b2-f194-4f14-b911-5193c0469418 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:35.890074 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-df50d2b2-f194-4f14-b911-5193c0469418 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:35.891678 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-df50d2b2-f194-4f14-b911-5193c0469418 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:35.892908 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-df50d2b2-f194-4f14-b911-5193c0469418 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1719 microversion: 2.20 time: 0.154222 Jun 06 13:11:35.893463 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 214/410] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:35 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1719 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:36.912274 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-151d8c0f-e166-4ae5-9264-99cafbcedc1b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:36.912935 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-151d8c0f-e166-4ae5-9264-99cafbcedc1b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:36.920188 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-151d8c0f-e166-4ae5-9264-99cafbcedc1b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:36.920636 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-151d8c0f-e166-4ae5-9264-99cafbcedc1b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:36.921462 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-151d8c0f-e166-4ae5-9264-99cafbcedc1b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:36.921903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-151d8c0f-e166-4ae5-9264-99cafbcedc1b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:37.053727 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-151d8c0f-e166-4ae5-9264-99cafbcedc1b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:37.062949 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-151d8c0f-e166-4ae5-9264-99cafbcedc1b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:37.064480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-151d8c0f-e166-4ae5-9264-99cafbcedc1b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:37.065638 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-151d8c0f-e166-4ae5-9264-99cafbcedc1b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1722 microversion: 2.20 time: 0.157286 Jun 06 13:11:37.066192 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 197/411] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:36 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:37.086440 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dbedfec4-a5d0-47c7-afc0-c4b482821136 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "59b71dc2-0bb4-495b-b8cc-a12e8a7597e4"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:11:37.087520 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dbedfec4-a5d0-47c7-afc0-c4b482821136 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:37.093500 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbedfec4-a5d0-47c7-afc0-c4b482821136 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:37.093918 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbedfec4-a5d0-47c7-afc0-c4b482821136 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:37.094666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbedfec4-a5d0-47c7-afc0-c4b482821136 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:37.095091 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbedfec4-a5d0-47c7-afc0-c4b482821136 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:37.624773 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:38.144624 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dbedfec4-a5d0-47c7-afc0-c4b482821136 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "POST /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.062338 Jun 06 13:11:38.145305 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 215/412] 10.222.0.13 () {62 vars in 1363 bytes} [Mon Jun 6 13:11:37 2022] POST /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments => generated 188 bytes in 1064 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:11:38.264604 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1c041582-7c7d-4dda-b534-ae0fbd8b5e11 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:11:38.264604 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1c041582-7c7d-4dda-b534-ae0fbd8b5e11 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:38.269065 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1c041582-7c7d-4dda-b534-ae0fbd8b5e11 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:38.269515 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1c041582-7c7d-4dda-b534-ae0fbd8b5e11 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:38.270279 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1c041582-7c7d-4dda-b534-ae0fbd8b5e11 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:38.270710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1c041582-7c7d-4dda-b534-ae0fbd8b5e11 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:38.531376 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1c041582-7c7d-4dda-b534-ae0fbd8b5e11 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "POST /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/action" status: 202 len: 0 microversion: 2.20 time: 0.273674 Jun 06 13:11:38.532226 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 198/413] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jun 6 13:11:38 2022] POST /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/action => generated 0 bytes in 275 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 06 13:11:38.542489 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-964e1ee6-c4b6-41bc-bd10-b861cabb727d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:38.543320 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-964e1ee6-c4b6-41bc-bd10-b861cabb727d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:38.548739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=76 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:38.552420 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-964e1ee6-c4b6-41bc-bd10-b861cabb727d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:38.552868 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-964e1ee6-c4b6-41bc-bd10-b861cabb727d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:38.553755 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-964e1ee6-c4b6-41bc-bd10-b861cabb727d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:38.554360 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-964e1ee6-c4b6-41bc-bd10-b861cabb727d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:38.699274 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-964e1ee6-c4b6-41bc-bd10-b861cabb727d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:38.711279 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-964e1ee6-c4b6-41bc-bd10-b861cabb727d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:38.713213 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-964e1ee6-c4b6-41bc-bd10-b861cabb727d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:38.714495 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-964e1ee6-c4b6-41bc-bd10-b861cabb727d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1748 microversion: 2.20 time: 0.176923 Jun 06 13:11:38.717940 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 216/414] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:38 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1748 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:39.732346 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b1c3e2e2-fc06-497d-a53a-dd81e24990aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:39.732953 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b1c3e2e2-fc06-497d-a53a-dd81e24990aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:39.741810 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1c3e2e2-fc06-497d-a53a-dd81e24990aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:39.741810 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1c3e2e2-fc06-497d-a53a-dd81e24990aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:39.741810 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1c3e2e2-fc06-497d-a53a-dd81e24990aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:39.741810 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1c3e2e2-fc06-497d-a53a-dd81e24990aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:39.881505 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b1c3e2e2-fc06-497d-a53a-dd81e24990aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:39.890360 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b1c3e2e2-fc06-497d-a53a-dd81e24990aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:39.891959 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b1c3e2e2-fc06-497d-a53a-dd81e24990aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:39.893319 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b1c3e2e2-fc06-497d-a53a-dd81e24990aa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1748 microversion: 2.20 time: 0.164888 Jun 06 13:11:39.893878 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 199/415] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:39 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:11:40.912165 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-16331129-f1b2-4cc5-b42f-ee759030fd5c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:40.912801 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-16331129-f1b2-4cc5-b42f-ee759030fd5c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:40.920511 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-16331129-f1b2-4cc5-b42f-ee759030fd5c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:40.921038 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-16331129-f1b2-4cc5-b42f-ee759030fd5c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:40.921823 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-16331129-f1b2-4cc5-b42f-ee759030fd5c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:40.922259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-16331129-f1b2-4cc5-b42f-ee759030fd5c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:41.058291 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-16331129-f1b2-4cc5-b42f-ee759030fd5c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:41.066873 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-16331129-f1b2-4cc5-b42f-ee759030fd5c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:41.068528 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-16331129-f1b2-4cc5-b42f-ee759030fd5c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:41.069716 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-16331129-f1b2-4cc5-b42f-ee759030fd5c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1748 microversion: 2.20 time: 0.161606 Jun 06 13:11:41.070262 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 217/416] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:40 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1748 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:42.088511 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c8930f46-a871-4d63-a0fd-2c313beb6491 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:42.089052 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c8930f46-a871-4d63-a0fd-2c313beb6491 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:42.095570 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c8930f46-a871-4d63-a0fd-2c313beb6491 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:42.096013 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c8930f46-a871-4d63-a0fd-2c313beb6491 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:42.097475 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c8930f46-a871-4d63-a0fd-2c313beb6491 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:42.097475 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c8930f46-a871-4d63-a0fd-2c313beb6491 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:42.226649 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c8930f46-a871-4d63-a0fd-2c313beb6491 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:42.236420 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c8930f46-a871-4d63-a0fd-2c313beb6491 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:42.237914 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c8930f46-a871-4d63-a0fd-2c313beb6491 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:42.239065 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c8930f46-a871-4d63-a0fd-2c313beb6491 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1750 microversion: 2.20 time: 0.154679 Jun 06 13:11:42.241861 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 200/417] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:42 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1750 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:43.259377 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f9480144-12a0-4314-9c18-596b368eac18 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:43.259921 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f9480144-12a0-4314-9c18-596b368eac18 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:43.266395 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f9480144-12a0-4314-9c18-596b368eac18 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:43.266888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f9480144-12a0-4314-9c18-596b368eac18 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:43.267667 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f9480144-12a0-4314-9c18-596b368eac18 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:43.268092 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f9480144-12a0-4314-9c18-596b368eac18 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:43.401351 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f9480144-12a0-4314-9c18-596b368eac18 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:43.409966 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f9480144-12a0-4314-9c18-596b368eac18 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:43.411447 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f9480144-12a0-4314-9c18-596b368eac18 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:43.412620 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f9480144-12a0-4314-9c18-596b368eac18 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.158533 Jun 06 13:11:43.413167 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 218/418] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:43 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:44.430262 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e2e5eb76-9ec3-434f-adf6-b7e9003ea8e2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:44.431397 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e2e5eb76-9ec3-434f-adf6-b7e9003ea8e2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:44.437857 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e2e5eb76-9ec3-434f-adf6-b7e9003ea8e2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:44.438301 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e2e5eb76-9ec3-434f-adf6-b7e9003ea8e2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:44.439077 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e2e5eb76-9ec3-434f-adf6-b7e9003ea8e2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:44.439490 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e2e5eb76-9ec3-434f-adf6-b7e9003ea8e2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:44.568669 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e2e5eb76-9ec3-434f-adf6-b7e9003ea8e2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:44.578077 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e2e5eb76-9ec3-434f-adf6-b7e9003ea8e2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:44.579634 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e2e5eb76-9ec3-434f-adf6-b7e9003ea8e2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:44.580782 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e2e5eb76-9ec3-434f-adf6-b7e9003ea8e2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.154472 Jun 06 13:11:44.581322 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 201/419] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:44 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:45.598094 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9104b309-1408-4f6d-a3a4-1c02f79aad02 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:45.598694 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9104b309-1408-4f6d-a3a4-1c02f79aad02 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:45.605471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9104b309-1408-4f6d-a3a4-1c02f79aad02 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:45.605995 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9104b309-1408-4f6d-a3a4-1c02f79aad02 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:45.606757 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9104b309-1408-4f6d-a3a4-1c02f79aad02 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:45.607188 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9104b309-1408-4f6d-a3a4-1c02f79aad02 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:45.730662 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9104b309-1408-4f6d-a3a4-1c02f79aad02 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:45.738958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9104b309-1408-4f6d-a3a4-1c02f79aad02 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:45.740479 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9104b309-1408-4f6d-a3a4-1c02f79aad02 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:45.741617 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9104b309-1408-4f6d-a3a4-1c02f79aad02 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.147405 Jun 06 13:11:45.742165 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 219/420] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:45 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:46.760456 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-94c73713-1169-4871-91fb-1168d1bfec93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:46.761136 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-94c73713-1169-4871-91fb-1168d1bfec93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:46.772164 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-94c73713-1169-4871-91fb-1168d1bfec93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:46.772164 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-94c73713-1169-4871-91fb-1168d1bfec93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:46.772164 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-94c73713-1169-4871-91fb-1168d1bfec93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:46.772164 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-94c73713-1169-4871-91fb-1168d1bfec93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:46.912188 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-94c73713-1169-4871-91fb-1168d1bfec93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:46.922120 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-94c73713-1169-4871-91fb-1168d1bfec93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:46.923777 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-94c73713-1169-4871-91fb-1168d1bfec93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:46.925086 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-94c73713-1169-4871-91fb-1168d1bfec93 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.169429 Jun 06 13:11:46.926977 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 202/421] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:46 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:47.952024 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d24e6c5c-2e8c-4929-8cb8-17c9fa739378 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:47.952699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d24e6c5c-2e8c-4929-8cb8-17c9fa739378 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:47.965534 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d24e6c5c-2e8c-4929-8cb8-17c9fa739378 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:47.966604 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d24e6c5c-2e8c-4929-8cb8-17c9fa739378 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:47.967563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d24e6c5c-2e8c-4929-8cb8-17c9fa739378 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:47.968175 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d24e6c5c-2e8c-4929-8cb8-17c9fa739378 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:48.112936 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d24e6c5c-2e8c-4929-8cb8-17c9fa739378 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:48.123091 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d24e6c5c-2e8c-4929-8cb8-17c9fa739378 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:48.125272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d24e6c5c-2e8c-4929-8cb8-17c9fa739378 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:48.126477 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d24e6c5c-2e8c-4929-8cb8-17c9fa739378 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.180101 Jun 06 13:11:48.127114 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 220/422] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:47 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:49.160487 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-71a9ace9-132c-45d5-a974-72ed9a57debc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:49.161035 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-71a9ace9-132c-45d5-a974-72ed9a57debc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:49.167805 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71a9ace9-132c-45d5-a974-72ed9a57debc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:49.168243 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71a9ace9-132c-45d5-a974-72ed9a57debc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:49.169001 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71a9ace9-132c-45d5-a974-72ed9a57debc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:49.169547 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71a9ace9-132c-45d5-a974-72ed9a57debc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:49.336105 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-71a9ace9-132c-45d5-a974-72ed9a57debc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:49.338511 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:49.345584 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-71a9ace9-132c-45d5-a974-72ed9a57debc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:49.347085 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-71a9ace9-132c-45d5-a974-72ed9a57debc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:49.348276 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-71a9ace9-132c-45d5-a974-72ed9a57debc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.191927 Jun 06 13:11:49.348832 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 203/423] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:49 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:50.366299 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a8e83cfb-a74f-460c-8f4a-c609d7b71097 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:50.366930 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a8e83cfb-a74f-460c-8f4a-c609d7b71097 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:50.374547 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8e83cfb-a74f-460c-8f4a-c609d7b71097 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:50.374994 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8e83cfb-a74f-460c-8f4a-c609d7b71097 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:50.375792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8e83cfb-a74f-460c-8f4a-c609d7b71097 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:50.376220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8e83cfb-a74f-460c-8f4a-c609d7b71097 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:50.532415 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a8e83cfb-a74f-460c-8f4a-c609d7b71097 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:50.542381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a8e83cfb-a74f-460c-8f4a-c609d7b71097 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:50.543998 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a8e83cfb-a74f-460c-8f4a-c609d7b71097 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:50.545640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a8e83cfb-a74f-460c-8f4a-c609d7b71097 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.183170 Jun 06 13:11:50.546388 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 221/424] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:50 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:50.723826 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d79f4634-c2fd-4dae-910a-78797de04dbd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:50.724976 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d79f4634-c2fd-4dae-910a-78797de04dbd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:50.732673 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d79f4634-c2fd-4dae-910a-78797de04dbd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:50.733632 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d79f4634-c2fd-4dae-910a-78797de04dbd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:50.734589 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d79f4634-c2fd-4dae-910a-78797de04dbd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:50.735213 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d79f4634-c2fd-4dae-910a-78797de04dbd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:50.921576 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-d79f4634-c2fd-4dae-910a-78797de04dbd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lazy-loading 'services' on Instance uuid b4130f6a-248b-4a11-8acf-926e747f6a9e {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:11:51.285030 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d79f4634-c2fd-4dae-910a-78797de04dbd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e/os-volume_attachments/4d51fbb9-8dd6-43e2-8613-d636054f8842" status: 202 len: 0 microversion: 2.1 time: 0.576906 Jun 06 13:11:51.285580 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 204/425] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 13:11:50 2022] DELETE /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e/os-volume_attachments/4d51fbb9-8dd6-43e2-8613-d636054f8842 => generated 0 bytes in 578 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:11:51.568110 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4e1849b6-2728-4ad7-acb4-5d4796548b10 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:51.569325 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4e1849b6-2728-4ad7-acb4-5d4796548b10 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:51.584661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e1849b6-2728-4ad7-acb4-5d4796548b10 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:51.585552 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e1849b6-2728-4ad7-acb4-5d4796548b10 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:51.586690 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e1849b6-2728-4ad7-acb4-5d4796548b10 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:51.602874 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4e1849b6-2728-4ad7-acb4-5d4796548b10 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:51.873124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4e1849b6-2728-4ad7-acb4-5d4796548b10 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:51.887616 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4e1849b6-2728-4ad7-acb4-5d4796548b10 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:51.919701 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4e1849b6-2728-4ad7-acb4-5d4796548b10 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:51.919701 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4e1849b6-2728-4ad7-acb4-5d4796548b10 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.334490 Jun 06 13:11:51.919701 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 222/426] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:51 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:52.953684 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-311e7433-b879-4afe-b2e1-dadba161ebbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:52.954372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-311e7433-b879-4afe-b2e1-dadba161ebbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:52.981152 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-311e7433-b879-4afe-b2e1-dadba161ebbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:52.981729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-311e7433-b879-4afe-b2e1-dadba161ebbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:52.982777 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-311e7433-b879-4afe-b2e1-dadba161ebbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:52.983314 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-311e7433-b879-4afe-b2e1-dadba161ebbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:53.253077 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-311e7433-b879-4afe-b2e1-dadba161ebbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:53.278858 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-311e7433-b879-4afe-b2e1-dadba161ebbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:53.283824 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-311e7433-b879-4afe-b2e1-dadba161ebbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:53.289436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-311e7433-b879-4afe-b2e1-dadba161ebbd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.340359 Jun 06 13:11:53.302921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 205/427] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:52 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 356 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:54.311269 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-130aa25c-d5d3-4d0d-9a84-a031c5cd357a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:54.312649 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-130aa25c-d5d3-4d0d-9a84-a031c5cd357a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:54.325397 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-130aa25c-d5d3-4d0d-9a84-a031c5cd357a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:54.328751 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-130aa25c-d5d3-4d0d-9a84-a031c5cd357a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:54.329782 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-130aa25c-d5d3-4d0d-9a84-a031c5cd357a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:54.330415 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-130aa25c-d5d3-4d0d-9a84-a031c5cd357a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:54.707329 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-130aa25c-d5d3-4d0d-9a84-a031c5cd357a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:54.717537 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-130aa25c-d5d3-4d0d-9a84-a031c5cd357a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:54.722260 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-130aa25c-d5d3-4d0d-9a84-a031c5cd357a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:54.726976 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-130aa25c-d5d3-4d0d-9a84-a031c5cd357a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.420493 Jun 06 13:11:54.745240 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 223/428] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:54 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:55.747080 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d574e56f-a678-4987-9733-7241b0a0b912 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:55.748073 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d574e56f-a678-4987-9733-7241b0a0b912 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:55.756524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=44 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:11:55.758428 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d574e56f-a678-4987-9733-7241b0a0b912 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:55.759132 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d574e56f-a678-4987-9733-7241b0a0b912 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:55.760203 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d574e56f-a678-4987-9733-7241b0a0b912 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:55.760861 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d574e56f-a678-4987-9733-7241b0a0b912 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:56.051074 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d574e56f-a678-4987-9733-7241b0a0b912 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:56.061907 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d574e56f-a678-4987-9733-7241b0a0b912 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:56.063416 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d574e56f-a678-4987-9733-7241b0a0b912 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:56.070447 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d574e56f-a678-4987-9733-7241b0a0b912 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.327426 Jun 06 13:11:56.071051 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 206/429] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:55 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:57.090279 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-04d1e71b-538b-462a-96f6-a7a4c532f7ec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:57.092187 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-04d1e71b-538b-462a-96f6-a7a4c532f7ec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:57.099856 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-04d1e71b-538b-462a-96f6-a7a4c532f7ec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:57.100548 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-04d1e71b-538b-462a-96f6-a7a4c532f7ec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:57.101535 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-04d1e71b-538b-462a-96f6-a7a4c532f7ec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:57.102183 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-04d1e71b-538b-462a-96f6-a7a4c532f7ec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:57.307781 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-04d1e71b-538b-462a-96f6-a7a4c532f7ec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:57.321035 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-04d1e71b-538b-462a-96f6-a7a4c532f7ec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:57.323218 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-04d1e71b-538b-462a-96f6-a7a4c532f7ec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:57.328985 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-04d1e71b-538b-462a-96f6-a7a4c532f7ec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.243316 Jun 06 13:11:57.329665 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 224/430] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:57 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:58.352136 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-28329e41-b00d-4550-af04-6ad9f368ccea tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:58.352911 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-28329e41-b00d-4550-af04-6ad9f368ccea tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:58.361534 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-28329e41-b00d-4550-af04-6ad9f368ccea tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:58.362391 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-28329e41-b00d-4550-af04-6ad9f368ccea tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:58.377473 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-28329e41-b00d-4550-af04-6ad9f368ccea tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:58.377473 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-28329e41-b00d-4550-af04-6ad9f368ccea tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:58.534519 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-28329e41-b00d-4550-af04-6ad9f368ccea tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:58.545345 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-28329e41-b00d-4550-af04-6ad9f368ccea tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:58.547061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-28329e41-b00d-4550-af04-6ad9f368ccea tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:58.548786 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-28329e41-b00d-4550-af04-6ad9f368ccea tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.201884 Jun 06 13:11:58.549412 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 207/431] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:58 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:11:59.568683 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-866c1a62-8e45-4131-88af-38bf8d4f3b9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:11:59.569947 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-866c1a62-8e45-4131-88af-38bf8d4f3b9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:11:59.577787 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-866c1a62-8e45-4131-88af-38bf8d4f3b9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:59.578300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-866c1a62-8e45-4131-88af-38bf8d4f3b9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:59.579699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-866c1a62-8e45-4131-88af-38bf8d4f3b9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:11:59.580236 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-866c1a62-8e45-4131-88af-38bf8d4f3b9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:11:59.739645 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-866c1a62-8e45-4131-88af-38bf8d4f3b9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:59.749564 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-866c1a62-8e45-4131-88af-38bf8d4f3b9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:59.751133 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-866c1a62-8e45-4131-88af-38bf8d4f3b9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:11:59.752653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-866c1a62-8e45-4131-88af-38bf8d4f3b9d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.188365 Jun 06 13:11:59.753212 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 225/432] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:11:59 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:00.115499 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-209fc404-433e-4836-8d79-66eccf455a15 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:00.116592 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-209fc404-433e-4836-8d79-66eccf455a15 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:00.127002 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-209fc404-433e-4836-8d79-66eccf455a15 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:00.127791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-209fc404-433e-4836-8d79-66eccf455a15 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:00.128961 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-209fc404-433e-4836-8d79-66eccf455a15 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:00.129800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-209fc404-433e-4836-8d79-66eccf455a15 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:00.171816 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-209fc404-433e-4836-8d79-66eccf455a15 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Going to try to terminate instance {{(pid=118134) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:12:00.532690 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-209fc404-433e-4836-8d79-66eccf455a15 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "DELETE /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 204 len: 0 microversion: 2.1 time: 0.429324 Jun 06 13:12:00.533463 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 208/433] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:12:00 2022] DELETE /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 0 bytes in 431 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:12:00.544608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d4d79ab9-9a17-412a-a7ad-f273aa7fc0e3 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:00.544608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d4d79ab9-9a17-412a-a7ad-f273aa7fc0e3 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:00.553344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d4d79ab9-9a17-412a-a7ad-f273aa7fc0e3 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:00.554249 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d4d79ab9-9a17-412a-a7ad-f273aa7fc0e3 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:00.555269 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d4d79ab9-9a17-412a-a7ad-f273aa7fc0e3 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:00.570093 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d4d79ab9-9a17-412a-a7ad-f273aa7fc0e3 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:00.737563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d4d79ab9-9a17-412a-a7ad-f273aa7fc0e3 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:00.758951 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d4d79ab9-9a17-412a-a7ad-f273aa7fc0e3 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1515 microversion: 2.1 time: 0.220711 Jun 06 13:12:00.760025 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 226/434] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:00 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1515 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:00.776396 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e90d94ac-f2cd-46fb-b709-be36cc86f383 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:00.777586 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e90d94ac-f2cd-46fb-b709-be36cc86f383 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:00.795188 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e90d94ac-f2cd-46fb-b709-be36cc86f383 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:00.795981 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e90d94ac-f2cd-46fb-b709-be36cc86f383 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:00.798051 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e90d94ac-f2cd-46fb-b709-be36cc86f383 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:00.801126 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e90d94ac-f2cd-46fb-b709-be36cc86f383 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:01.054569 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e90d94ac-f2cd-46fb-b709-be36cc86f383 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:01.067932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e90d94ac-f2cd-46fb-b709-be36cc86f383 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:01.072281 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e90d94ac-f2cd-46fb-b709-be36cc86f383 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:01.073796 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e90d94ac-f2cd-46fb-b709-be36cc86f383 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.302355 Jun 06 13:12:01.074369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 209/435] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:00 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:01.779742 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e612645e-8d27-40fb-b6bd-8ce52b79edea tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:01.781136 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e612645e-8d27-40fb-b6bd-8ce52b79edea tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:01.791252 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e612645e-8d27-40fb-b6bd-8ce52b79edea tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:01.791252 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e612645e-8d27-40fb-b6bd-8ce52b79edea tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:01.794168 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e612645e-8d27-40fb-b6bd-8ce52b79edea tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:01.794845 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e612645e-8d27-40fb-b6bd-8ce52b79edea tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:02.000250 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e612645e-8d27-40fb-b6bd-8ce52b79edea tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:02.009285 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e612645e-8d27-40fb-b6bd-8ce52b79edea tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1515 microversion: 2.1 time: 0.235741 Jun 06 13:12:02.020174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 227/436] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:01 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1515 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:02.092382 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1d9b30a8-2ae2-43f4-b0b2-4f3866ac8eec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:02.093658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1d9b30a8-2ae2-43f4-b0b2-4f3866ac8eec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:02.102075 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1d9b30a8-2ae2-43f4-b0b2-4f3866ac8eec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:02.102864 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1d9b30a8-2ae2-43f4-b0b2-4f3866ac8eec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:02.104521 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1d9b30a8-2ae2-43f4-b0b2-4f3866ac8eec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:02.105316 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1d9b30a8-2ae2-43f4-b0b2-4f3866ac8eec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:02.298745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1d9b30a8-2ae2-43f4-b0b2-4f3866ac8eec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:02.307853 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1d9b30a8-2ae2-43f4-b0b2-4f3866ac8eec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:02.309617 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1d9b30a8-2ae2-43f4-b0b2-4f3866ac8eec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:02.310839 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1d9b30a8-2ae2-43f4-b0b2-4f3866ac8eec tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.222851 Jun 06 13:12:02.311416 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 210/437] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:02 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:03.028050 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e7a0628e-b80e-40ab-b3b4-6fa6438b668b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:03.029221 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e7a0628e-b80e-40ab-b3b4-6fa6438b668b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:03.035742 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7a0628e-b80e-40ab-b3b4-6fa6438b668b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:03.036434 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7a0628e-b80e-40ab-b3b4-6fa6438b668b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:03.037690 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7a0628e-b80e-40ab-b3b4-6fa6438b668b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:03.038299 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7a0628e-b80e-40ab-b3b4-6fa6438b668b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:03.183071 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e7a0628e-b80e-40ab-b3b4-6fa6438b668b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:03.192789 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e7a0628e-b80e-40ab-b3b4-6fa6438b668b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1515 microversion: 2.1 time: 0.168945 Jun 06 13:12:03.204696 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 228/438] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:03 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1515 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:03.329327 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-850f8323-acea-4134-9903-0d28fc7cfec9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:03.329835 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-850f8323-acea-4134-9903-0d28fc7cfec9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:03.336277 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-850f8323-acea-4134-9903-0d28fc7cfec9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:03.336718 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-850f8323-acea-4134-9903-0d28fc7cfec9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:03.337463 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-850f8323-acea-4134-9903-0d28fc7cfec9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:03.337888 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-850f8323-acea-4134-9903-0d28fc7cfec9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:03.484219 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-850f8323-acea-4134-9903-0d28fc7cfec9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:03.492796 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-850f8323-acea-4134-9903-0d28fc7cfec9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:03.494494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-850f8323-acea-4134-9903-0d28fc7cfec9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:03.496434 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-850f8323-acea-4134-9903-0d28fc7cfec9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.171183 Jun 06 13:12:03.496982 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 211/439] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:03 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:03.664420 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-ec6fe926-68c7-4d1b-bde2-6fbdc74d5b9c req-360f7c9d-004d-4d04-a2b5-71115c121d15 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "b4130f6a-248b-4a11-8acf-926e747f6a9e", "name": "network-vif-deleted", "tag": "e969dde9-8fb6-4882-845d-107e055837eb"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:03.674724 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-ec6fe926-68c7-4d1b-bde2-6fbdc74d5b9c req-360f7c9d-004d-4d04-a2b5-71115c121d15 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:03.677776 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-ec6fe926-68c7-4d1b-bde2-6fbdc74d5b9c req-360f7c9d-004d-4d04-a2b5-71115c121d15 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:03.688611 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-ec6fe926-68c7-4d1b-bde2-6fbdc74d5b9c req-360f7c9d-004d-4d04-a2b5-71115c121d15 service nova] Creating event network-vif-deleted:e969dde9-8fb6-4882-845d-107e055837eb for instance b4130f6a-248b-4a11-8acf-926e747f6a9e on hv-cinder-75510 Jun 06 13:12:03.693627 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-ec6fe926-68c7-4d1b-bde2-6fbdc74d5b9c req-360f7c9d-004d-4d04-a2b5-71115c121d15 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033491 Jun 06 13:12:03.694225 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 229/440] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:12:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:04.209189 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-abed3968-cef4-47c1-ae0c-648a5e9c721b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:04.210379 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-abed3968-cef4-47c1-ae0c-648a5e9c721b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:04.218552 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abed3968-cef4-47c1-ae0c-648a5e9c721b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:04.219277 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abed3968-cef4-47c1-ae0c-648a5e9c721b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:04.220236 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abed3968-cef4-47c1-ae0c-648a5e9c721b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:04.220827 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abed3968-cef4-47c1-ae0c-648a5e9c721b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:04.264788 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abed3968-cef4-47c1-ae0c-648a5e9c721b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:04.265472 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abed3968-cef4-47c1-ae0c-648a5e9c721b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:04.266156 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-abed3968-cef4-47c1-ae0c-648a5e9c721b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lazy-loading 'fault' on Instance uuid b4130f6a-248b-4a11-8acf-926e747f6a9e {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:12:04.315102 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-abed3968-cef4-47c1-ae0c-648a5e9c721b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:04.330718 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-abed3968-cef4-47c1-ae0c-648a5e9c721b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1309 microversion: 2.1 time: 0.125284 Jun 06 13:12:04.340685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 212/441] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:04 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1309 bytes in 136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:04.542234 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e8519935-accb-460c-8d35-be6000d43ec1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:04.542234 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e8519935-accb-460c-8d35-be6000d43ec1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:04.542234 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8519935-accb-460c-8d35-be6000d43ec1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:04.542234 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8519935-accb-460c-8d35-be6000d43ec1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:04.543225 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8519935-accb-460c-8d35-be6000d43ec1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:04.543225 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e8519935-accb-460c-8d35-be6000d43ec1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:04.723427 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e8519935-accb-460c-8d35-be6000d43ec1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:04.736317 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e8519935-accb-460c-8d35-be6000d43ec1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:04.738132 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e8519935-accb-460c-8d35-be6000d43ec1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:04.740725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e8519935-accb-460c-8d35-be6000d43ec1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.225834 Jun 06 13:12:04.741833 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 230/442] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:04 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:05.358478 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b1b69cab-48f8-46af-9aa9-ad94670fb300 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:05.359076 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b1b69cab-48f8-46af-9aa9-ad94670fb300 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:05.366927 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1b69cab-48f8-46af-9aa9-ad94670fb300 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:05.367373 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1b69cab-48f8-46af-9aa9-ad94670fb300 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:05.368275 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1b69cab-48f8-46af-9aa9-ad94670fb300 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:05.375841 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1b69cab-48f8-46af-9aa9-ad94670fb300 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:05.439440 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1b69cab-48f8-46af-9aa9-ad94670fb300 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:05.439440 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1b69cab-48f8-46af-9aa9-ad94670fb300 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:05.439440 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-b1b69cab-48f8-46af-9aa9-ad94670fb300 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lazy-loading 'fault' on Instance uuid b4130f6a-248b-4a11-8acf-926e747f6a9e {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:12:05.499212 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b1b69cab-48f8-46af-9aa9-ad94670fb300 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:05.507969 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b1b69cab-48f8-46af-9aa9-ad94670fb300 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 200 len: 1309 microversion: 2.1 time: 0.153852 Jun 06 13:12:05.508907 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 213/443] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:05 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 1309 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:05.759651 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dc92a2cc-cf1e-41a8-95b0-ad12fdb39b16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:05.761743 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dc92a2cc-cf1e-41a8-95b0-ad12fdb39b16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:05.768059 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc92a2cc-cf1e-41a8-95b0-ad12fdb39b16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:05.768733 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc92a2cc-cf1e-41a8-95b0-ad12fdb39b16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:05.769670 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc92a2cc-cf1e-41a8-95b0-ad12fdb39b16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:05.771633 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc92a2cc-cf1e-41a8-95b0-ad12fdb39b16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:05.776158 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:UPDATE=4,nova_cell1:SELECT=94,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:05.971568 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dc92a2cc-cf1e-41a8-95b0-ad12fdb39b16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:05.987189 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dc92a2cc-cf1e-41a8-95b0-ad12fdb39b16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:05.990095 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dc92a2cc-cf1e-41a8-95b0-ad12fdb39b16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:05.998775 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dc92a2cc-cf1e-41a8-95b0-ad12fdb39b16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.243047 Jun 06 13:12:05.999698 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 231/444] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:05 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:06.300606 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ba6de8a3-55db-421c-8a8d-82b841efc69f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "d20211b5-66ff-4f7d-855d-18cabdcbc58e"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:06.304662 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ba6de8a3-55db-421c-8a8d-82b841efc69f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:06.337894 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ba6de8a3-55db-421c-8a8d-82b841efc69f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:06.344627 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ba6de8a3-55db-421c-8a8d-82b841efc69f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:06.348695 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ba6de8a3-55db-421c-8a8d-82b841efc69f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:06.351136 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ba6de8a3-55db-421c-8a8d-82b841efc69f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:06.537314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cc983858-dfd7-4eab-9b0d-3ed79e3b911d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:06.538229 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cc983858-dfd7-4eab-9b0d-3ed79e3b911d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: b4130f6a-248b-4a11-8acf-926e747f6a9e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:06.549669 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cc983858-dfd7-4eab-9b0d-3ed79e3b911d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:06.549669 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cc983858-dfd7-4eab-9b0d-3ed79e3b911d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:06.550334 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cc983858-dfd7-4eab-9b0d-3ed79e3b911d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:06.550969 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cc983858-dfd7-4eab-9b0d-3ed79e3b911d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:06.587020 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-cc983858-dfd7-4eab-9b0d-3ed79e3b911d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] HTTP exception thrown: Instance b4130f6a-248b-4a11-8acf-926e747f6a9e could not be found. Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cc983858-dfd7-4eab-9b0d-3ed79e3b911d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Request method failure captured: Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e HTTP/1.1 Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfy2ALTj8614tDK9nvfLJTMxRvHnJcNYms76r5s3r3Ka6Wnis2ftex8lauSKk1rYNKTETZUEisNGVLiwsBB7fBQ8uePYzdBI0grEgOLiwyZwNOZ7zzIn1dIHtgCeOkgjsDDyz4rSoCvfhyYPfr1pHjL9_6Ec5PvHmQOVuRTAN7_8Z1k Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: c6c440914e0f40e49b9fc8ab9f4b6f48 Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2115950294 Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:12:06.589863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:12:06.596314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c6c440914e0f40e49b9fc8ab9f4b6f48", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6c440914e0f40e49b9fc8ab9f4b6f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6c440914e0f40e49b9fc8ab9f4b6f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c6c440914e0f40e49b9fc8ab9f4b6f48"}]}] Jun 06 13:12:06.596314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-VolumesSnapshotTestJSON-2115950294 Jun 06 13:12:06.596314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: c6c440914e0f40e49b9fc8ab9f4b6f48 Jun 06 13:12:06.596314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2115950294 Jun 06 13:12:06.596314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-VolumesSnapshotTestJSON-2115950294-project Jun 06 13:12:06.596314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:12:06.596314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:12:06.596314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 593bba746dfc40dfbe768b4b9f0c78e3 Jun 06 13:12:06.596314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-VolumesSnapshotTestJSON-2115950294-project Jun 06 13:12:06.596314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:12:06.596314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance b4130f6a-248b-4a11-8acf-926e747f6a9e could not be found. Jun 06 13:12:06.596314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': 'b4130f6a-248b-4a11-8acf-926e747f6a9e'} Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance b4130f6a-248b-4a11-8acf-926e747f6a9e could not be found. Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:12:06.597346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance b4130f6a-248b-4a11-8acf-926e747f6a9e could not be found. Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance b4130f6a-248b-4a11-8acf-926e747f6a9e could not be found. Jun 06 13:12:06.598989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:12:06.626939 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cc983858-dfd7-4eab-9b0d-3ed79e3b911d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Returning 404 to user: Instance b4130f6a-248b-4a11-8acf-926e747f6a9e could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:12:06.629662 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cc983858-dfd7-4eab-9b0d-3ed79e3b911d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e" status: 404 len: 111 microversion: 2.1 time: 0.106038 Jun 06 13:12:06.631009 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 232/445] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:06 2022] GET /compute/v2.1/servers/b4130f6a-248b-4a11-8acf-926e747f6a9e => generated 111 bytes in 109 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:12:07.016889 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ed58c2b3-20d8-4071-be8b-0c6257949e9e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:07.017790 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ed58c2b3-20d8-4071-be8b-0c6257949e9e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:07.029088 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed58c2b3-20d8-4071-be8b-0c6257949e9e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:07.029791 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed58c2b3-20d8-4071-be8b-0c6257949e9e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:07.030564 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed58c2b3-20d8-4071-be8b-0c6257949e9e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:07.031180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed58c2b3-20d8-4071-be8b-0c6257949e9e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:07.214791 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ed58c2b3-20d8-4071-be8b-0c6257949e9e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:07.224476 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ed58c2b3-20d8-4071-be8b-0c6257949e9e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:07.239309 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ed58c2b3-20d8-4071-be8b-0c6257949e9e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:07.239309 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ed58c2b3-20d8-4071-be8b-0c6257949e9e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.214911 Jun 06 13:12:07.239309 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 233/446] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:07 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:07.408113 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ba6de8a3-55db-421c-8a8d-82b841efc69f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "POST /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.111255 Jun 06 13:12:07.411411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 214/447] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:12:06 2022] POST /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-volume_attachments => generated 194 bytes in 1113 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:08.246467 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-64a4d69e-773c-415a-b415-78798af87574 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:08.247303 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-64a4d69e-773c-415a-b415-78798af87574 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:08.254836 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-64a4d69e-773c-415a-b415-78798af87574 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:08.255358 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-64a4d69e-773c-415a-b415-78798af87574 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:08.256361 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-64a4d69e-773c-415a-b415-78798af87574 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:08.256977 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-64a4d69e-773c-415a-b415-78798af87574 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:08.427123 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-64a4d69e-773c-415a-b415-78798af87574 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:08.438261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-64a4d69e-773c-415a-b415-78798af87574 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:08.440206 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-64a4d69e-773c-415a-b415-78798af87574 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:08.441922 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-64a4d69e-773c-415a-b415-78798af87574 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.199564 Jun 06 13:12:08.442670 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 234/448] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:08 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:09.461173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c913a5c3-dc2b-42f5-8db5-5289192bfb34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:09.462033 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c913a5c3-dc2b-42f5-8db5-5289192bfb34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:09.469917 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c913a5c3-dc2b-42f5-8db5-5289192bfb34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:09.470505 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c913a5c3-dc2b-42f5-8db5-5289192bfb34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:09.471614 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c913a5c3-dc2b-42f5-8db5-5289192bfb34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:09.472126 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c913a5c3-dc2b-42f5-8db5-5289192bfb34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:09.633517 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c913a5c3-dc2b-42f5-8db5-5289192bfb34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:09.644045 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c913a5c3-dc2b-42f5-8db5-5289192bfb34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:09.645850 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c913a5c3-dc2b-42f5-8db5-5289192bfb34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:09.647139 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c913a5c3-dc2b-42f5-8db5-5289192bfb34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.190180 Jun 06 13:12:09.648232 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 215/449] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:09 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:10.685392 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8ebda5ab-af31-4f56-ae22-81a9c2c5321d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:10.686472 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8ebda5ab-af31-4f56-ae22-81a9c2c5321d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:10.688512 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=38 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:10.700237 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8ebda5ab-af31-4f56-ae22-81a9c2c5321d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:10.700694 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8ebda5ab-af31-4f56-ae22-81a9c2c5321d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:10.701488 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8ebda5ab-af31-4f56-ae22-81a9c2c5321d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:10.701916 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8ebda5ab-af31-4f56-ae22-81a9c2c5321d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:10.840995 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8ebda5ab-af31-4f56-ae22-81a9c2c5321d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:10.849651 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8ebda5ab-af31-4f56-ae22-81a9c2c5321d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:10.915007 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8ebda5ab-af31-4f56-ae22-81a9c2c5321d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:10.915007 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8ebda5ab-af31-4f56-ae22-81a9c2c5321d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.187634 Jun 06 13:12:10.915007 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 235/450] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:10 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:11.725823 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9ece4453-2ba4-4d82-b044-499975765a9f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:11.733185 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9ece4453-2ba4-4d82-b044-499975765a9f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:11.735863 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9ece4453-2ba4-4d82-b044-499975765a9f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:11.740076 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9ece4453-2ba4-4d82-b044-499975765a9f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:11.741035 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9ece4453-2ba4-4d82-b044-499975765a9f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:11.741530 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9ece4453-2ba4-4d82-b044-499975765a9f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:11.745850 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=94,nova_cell1:INSERT=3,nova_cell1:UPDATE=3 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:11.782704 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9ece4453-2ba4-4d82-b044-499975765a9f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db/ips" status: 200 len: 150 microversion: 2.1 time: 0.060832 Jun 06 13:12:11.783298 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 216/451] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 13:12:11 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db/ips => generated 150 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:11.794304 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ae03f35f-1ebd-4969-859e-167c35f9bf80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a5518ec4-1cc0-4e33-8a7a-97d829894e35"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:11.796051 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ae03f35f-1ebd-4969-859e-167c35f9bf80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:11.803148 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ae03f35f-1ebd-4969-859e-167c35f9bf80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:11.803729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ae03f35f-1ebd-4969-859e-167c35f9bf80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:11.805036 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ae03f35f-1ebd-4969-859e-167c35f9bf80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:11.805603 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ae03f35f-1ebd-4969-859e-167c35f9bf80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:11.902107 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-ae03f35f-1ebd-4969-859e-167c35f9bf80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Invalid volume: volume a5518ec4-1cc0-4e33-8a7a-97d829894e35 is already attached to instances: ec960d68-c9a5-4886-a3f3-07c63abf3cce Jun 06 13:12:11.902828 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a12ed3dc-6682-4bb2-84d9-765838954f0b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:11.904126 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a12ed3dc-6682-4bb2-84d9-765838954f0b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ae03f35f-1ebd-4969-859e-167c35f9bf80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: POST /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db/os-volume_attachments HTTP/1.1 Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 74 Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:12:11.908679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:12:11.914089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:12:11.914089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:12:11.914089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:12:11.914089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:12:11.914089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:12:11.914089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:12:11.914089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:12:11.914089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:12:11.914089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:12:11.914089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Jun 06 13:12:11.914089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {"volumeAttachment": {"volumeId": "a5518ec4-1cc0-4e33-8a7a-97d829894e35"}} Jun 06 13:12:11.914089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Invalid volume: volume a5518ec4-1cc0-4e33-8a7a-97d829894e35 is already attached to instances: ec960d68-c9a5-4886-a3f3-07c63abf3cce Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'server_id': '02dfda62-0a51-417a-807a-c653d5fc26db', 'body': {'volumeAttachment': {'volumeId': 'a5518ec4-1cc0-4e33-8a7a-97d829894e35'}}} Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume a5518ec4-1cc0-4e33-8a7a-97d829894e35 is already attached to instances: ec960d68-c9a5-4886-a3f3-07c63abf3cce Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:12:11.915120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume a5518ec4-1cc0-4e33-8a7a-97d829894e35 is already attached to instances: ec960d68-c9a5-4886-a3f3-07c63abf3cce Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:11.916491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:12:11.917755 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:12:11.917755 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:12:11.917755 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:12:11.917755 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume a5518ec4-1cc0-4e33-8a7a-97d829894e35 is already attached to instances: ec960d68-c9a5-4886-a3f3-07c63abf3cce Jun 06 13:12:11.917755 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:12:11.917755 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ae03f35f-1ebd-4969-859e-167c35f9bf80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 400 to user: Invalid volume: volume a5518ec4-1cc0-4e33-8a7a-97d829894e35 is already attached to instances: ec960d68-c9a5-4886-a3f3-07c63abf3cce {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:12:11.917755 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ae03f35f-1ebd-4969-859e-167c35f9bf80 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "POST /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.126665 Jun 06 13:12:11.919905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a12ed3dc-6682-4bb2-84d9-765838954f0b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:11.920654 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 236/452] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:12:11 2022] POST /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db/os-volume_attachments => generated 174 bytes in 131 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 13:12:11.921288 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a12ed3dc-6682-4bb2-84d9-765838954f0b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:11.922167 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a12ed3dc-6682-4bb2-84d9-765838954f0b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:11.922702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a12ed3dc-6682-4bb2-84d9-765838954f0b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:11.929036 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a403845f-3ec5-4c6d-8908-d70caf25e6ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:11.929603 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a403845f-3ec5-4c6d-8908-d70caf25e6ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:11.939683 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a403845f-3ec5-4c6d-8908-d70caf25e6ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:11.940465 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a403845f-3ec5-4c6d-8908-d70caf25e6ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:11.941865 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a403845f-3ec5-4c6d-8908-d70caf25e6ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:11.942523 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a403845f-3ec5-4c6d-8908-d70caf25e6ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:11.972017 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a403845f-3ec5-4c6d-8908-d70caf25e6ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:12:12.092189 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a12ed3dc-6682-4bb2-84d9-765838954f0b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:12.107987 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a12ed3dc-6682-4bb2-84d9-765838954f0b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:12.109759 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a12ed3dc-6682-4bb2-84d9-765838954f0b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:12.111148 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a12ed3dc-6682-4bb2-84d9-765838954f0b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.222191 Jun 06 13:12:12.111749 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 217/453] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:11 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:12.313491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a403845f-3ec5-4c6d-8908-d70caf25e6ba tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 204 len: 0 microversion: 2.1 time: 0.388150 Jun 06 13:12:12.314432 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 237/454] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:12:11 2022] DELETE /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 0 bytes in 390 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 13:12:12.323371 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-21a6ae48-47ad-4350-bac9-c9cb52e8888b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:12.324067 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-21a6ae48-47ad-4350-bac9-c9cb52e8888b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:12.333133 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-21a6ae48-47ad-4350-bac9-c9cb52e8888b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:12.336225 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-21a6ae48-47ad-4350-bac9-c9cb52e8888b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:12.336605 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-21a6ae48-47ad-4350-bac9-c9cb52e8888b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:12.337034 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-21a6ae48-47ad-4350-bac9-c9cb52e8888b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:12.415405 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-5baa7e32-4df6-4797-8a38-14db6f830043 req-739e6c0f-bd54-4a07-b080-eadbdf26c348 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc5ce11-0a01-44fd-9be7-c095a8254551", "name": "network-vif-plugged", "status": "completed", "tag": "5fd26d76-0c93-4177-8c73-21f7779282ef"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:12.424561 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-5baa7e32-4df6-4797-8a38-14db6f830043 req-739e6c0f-bd54-4a07-b080-eadbdf26c348 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:12.424981 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-5baa7e32-4df6-4797-8a38-14db6f830043 req-739e6c0f-bd54-4a07-b080-eadbdf26c348 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:12.464688 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-5baa7e32-4df6-4797-8a38-14db6f830043 req-739e6c0f-bd54-4a07-b080-eadbdf26c348 service nova] Creating event network-vif-plugged:5fd26d76-0c93-4177-8c73-21f7779282ef for instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 on hv-cinder-75510 Jun 06 13:12:12.474029 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-5baa7e32-4df6-4797-8a38-14db6f830043 req-739e6c0f-bd54-4a07-b080-eadbdf26c348 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.062560 Jun 06 13:12:12.474873 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 238/455] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:12:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:12:12.560479 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-21a6ae48-47ad-4350-bac9-c9cb52e8888b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:12.568487 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-21a6ae48-47ad-4350-bac9-c9cb52e8888b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1681 microversion: 2.1 time: 0.248815 Jun 06 13:12:12.569355 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 218/456] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:12 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1681 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:13.136523 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e864479c-909f-4ef3-869e-29dffd67f479 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:13.139451 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e864479c-909f-4ef3-869e-29dffd67f479 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:13.153962 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e864479c-909f-4ef3-869e-29dffd67f479 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:13.154824 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e864479c-909f-4ef3-869e-29dffd67f479 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:13.156443 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e864479c-909f-4ef3-869e-29dffd67f479 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:13.157221 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e864479c-909f-4ef3-869e-29dffd67f479 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:13.306865 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e864479c-909f-4ef3-869e-29dffd67f479 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:13.317310 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e864479c-909f-4ef3-869e-29dffd67f479 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:13.319124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e864479c-909f-4ef3-869e-29dffd67f479 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:13.320526 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e864479c-909f-4ef3-869e-29dffd67f479 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.194084 Jun 06 13:12:13.332449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 239/457] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:13 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:13.587490 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-8f945505-f8eb-4b4b-9f79-898825dac707 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:13.588064 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8f945505-f8eb-4b4b-9f79-898825dac707 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:13.595907 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8f945505-f8eb-4b4b-9f79-898825dac707 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:13.596437 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8f945505-f8eb-4b4b-9f79-898825dac707 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:13.597328 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8f945505-f8eb-4b4b-9f79-898825dac707 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:13.597829 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8f945505-f8eb-4b4b-9f79-898825dac707 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:13.753988 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-8f945505-f8eb-4b4b-9f79-898825dac707 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:13.762322 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-8f945505-f8eb-4b4b-9f79-898825dac707 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1681 microversion: 2.1 time: 0.178609 Jun 06 13:12:13.763469 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 219/458] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:13 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1681 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:14.339808 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a71dc661-37f9-4d22-9ad1-98b9354cf31f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:14.340463 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a71dc661-37f9-4d22-9ad1-98b9354cf31f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:14.347809 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a71dc661-37f9-4d22-9ad1-98b9354cf31f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:14.348265 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a71dc661-37f9-4d22-9ad1-98b9354cf31f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:14.349013 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a71dc661-37f9-4d22-9ad1-98b9354cf31f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:14.349483 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a71dc661-37f9-4d22-9ad1-98b9354cf31f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:14.479394 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a71dc661-37f9-4d22-9ad1-98b9354cf31f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:14.489254 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a71dc661-37f9-4d22-9ad1-98b9354cf31f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:14.490982 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a71dc661-37f9-4d22-9ad1-98b9354cf31f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:14.492173 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a71dc661-37f9-4d22-9ad1-98b9354cf31f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.156663 Jun 06 13:12:14.492739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 240/459] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:14 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:14.783263 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a79b0d11-2812-462f-8354-bde065de17d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:14.787911 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a79b0d11-2812-462f-8354-bde065de17d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:14.792559 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a79b0d11-2812-462f-8354-bde065de17d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:14.793323 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a79b0d11-2812-462f-8354-bde065de17d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:14.794374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a79b0d11-2812-462f-8354-bde065de17d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:14.794951 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a79b0d11-2812-462f-8354-bde065de17d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:15.183343 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a79b0d11-2812-462f-8354-bde065de17d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:15.191740 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a79b0d11-2812-462f-8354-bde065de17d1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1681 microversion: 2.1 time: 0.415106 Jun 06 13:12:15.192366 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 220/460] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:14 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1681 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:15.512226 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cb6ec910-8162-4fb3-bbd4-956beb14736c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:15.512855 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cb6ec910-8162-4fb3-bbd4-956beb14736c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:15.519518 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cb6ec910-8162-4fb3-bbd4-956beb14736c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:15.520001 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cb6ec910-8162-4fb3-bbd4-956beb14736c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:15.520785 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cb6ec910-8162-4fb3-bbd4-956beb14736c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:15.521224 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cb6ec910-8162-4fb3-bbd4-956beb14736c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:15.593905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ac35155a-5a69-4193-93dd-9b6d363c06b0 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Action: 'create', calling method: .version_select at 0x7f0ef67d93a0>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-517416217", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBMcMEYcmoiCNonTtxJ7eL0YGXSuK73Q3gtQNHnw0dFvy0p9Ch2MUCzgvT4c0M5STB+wmOlwZo1HsTS15TFil7j47ZXYDD1dAfOE/JwM9Pm82P8DFIyHsaApIBzfFftDrzw=="}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:15.608713 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-ac35155a-5a69-4193-93dd-9b6d363c06b0 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Getting quotas for project ef58e682b96f4a2cb0b35ad6eee991e5. Resources: {'key_pairs'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:12:15.612756 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-ac35155a-5a69-4193-93dd-9b6d363c06b0 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Getting quotas for user d6dad40e92684d1f95fc9b3b0a0337ed and project ef58e682b96f4a2cb0b35ad6eee991e5. Resources: {'key_pairs'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:12:15.653128 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cb6ec910-8162-4fb3-bbd4-956beb14736c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:15.662390 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cb6ec910-8162-4fb3-bbd4-956beb14736c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:15.663933 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cb6ec910-8162-4fb3-bbd4-956beb14736c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:15.665097 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cb6ec910-8162-4fb3-bbd4-956beb14736c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.156826 Jun 06 13:12:15.665654 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 241/461] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:15 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:15.704573 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ac35155a-5a69-4193-93dd-9b6d363c06b0 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.114887 Jun 06 13:12:15.705167 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 221/462] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 13:12:15 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:12:15.754165 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-15004797", "imageRef": "f662b6b6-a2fb-4a0b-91ea-2f2610878122", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-517416217", "networks": [{"uuid": "bb588140-7e24-4b8c-bf65-6a9e026b15af"}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:15.802316 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] validate_networks() for [('bb588140-7e24-4b8c-bf65-6a9e026b15af', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:12:16.174471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:12:16.174918 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:12:16.175395 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:12:16.175838 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:12:16.176246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:12:16.186795 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:16.190180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:16.190180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:16.190180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:16.206481 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Getting quotas for project ef58e682b96f4a2cb0b35ad6eee991e5. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:12:16.210902 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Getting quotas for user d6dad40e92684d1f95fc9b3b0a0337ed and project ef58e682b96f4a2cb0b35ad6eee991e5. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:12:16.211086 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0168d879-e22c-4cdb-9754-a1747691f0b1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:16.211806 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0168d879-e22c-4cdb-9754-a1747691f0b1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:16.223379 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0168d879-e22c-4cdb-9754-a1747691f0b1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:16.223379 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0168d879-e22c-4cdb-9754-a1747691f0b1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:16.223379 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0168d879-e22c-4cdb-9754-a1747691f0b1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:16.223379 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0168d879-e22c-4cdb-9754-a1747691f0b1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:16.224389 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:12:16.225836 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='f662b6b6-a2fb-4a0b-91ea-2f2610878122',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:12:16.328993 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e78eefb2-ae94-4b64-b3f2-f4e691cafd3f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.578547 Jun 06 13:12:16.334839 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 242/463] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:12:15 2022] POST /compute/v2.1/servers => generated 380 bytes in 585 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:12:16.339629 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-41ef130e-6721-49f5-aa4e-835549a54a35 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:16.340243 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-41ef130e-6721-49f5-aa4e-835549a54a35 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:16.374552 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-0168d879-e22c-4cdb-9754-a1747691f0b1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:16.383264 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0168d879-e22c-4cdb-9754-a1747691f0b1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1681 microversion: 2.1 time: 0.177443 Jun 06 13:12:16.388144 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 222/464] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:16 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1681 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:16.404826 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-41ef130e-6721-49f5-aa4e-835549a54a35 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:16.412688 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-41ef130e-6721-49f5-aa4e-835549a54a35 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1256 microversion: 2.1 time: 0.076804 Jun 06 13:12:16.413433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 243/465] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:16 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1256 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:16.683765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6e555be0-7431-444f-ba11-8ff325902c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:16.684620 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6e555be0-7431-444f-ba11-8ff325902c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:16.690821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6e555be0-7431-444f-ba11-8ff325902c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:16.691262 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6e555be0-7431-444f-ba11-8ff325902c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:16.692471 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6e555be0-7431-444f-ba11-8ff325902c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:16.692471 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6e555be0-7431-444f-ba11-8ff325902c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:16.821789 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6e555be0-7431-444f-ba11-8ff325902c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:16.830388 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6e555be0-7431-444f-ba11-8ff325902c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:16.831972 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6e555be0-7431-444f-ba11-8ff325902c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:16.833166 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6e555be0-7431-444f-ba11-8ff325902c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.153392 Jun 06 13:12:16.833724 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 223/466] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:16 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:17.375624 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-371320809", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "networks": [{"uuid": "a2d1a624-a5a7-489f-9565-0babb77b566b"}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:17.400831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-63f2d799-a7ef-4fa0-bf02-99f6ec9dcd11 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:17.401444 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-63f2d799-a7ef-4fa0-bf02-99f6ec9dcd11 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:17.408475 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-63f2d799-a7ef-4fa0-bf02-99f6ec9dcd11 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:17.408921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-63f2d799-a7ef-4fa0-bf02-99f6ec9dcd11 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:17.409690 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-63f2d799-a7ef-4fa0-bf02-99f6ec9dcd11 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:17.410125 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-63f2d799-a7ef-4fa0-bf02-99f6ec9dcd11 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:17.442895 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] validate_networks() for [('a2d1a624-a5a7-489f-9565-0babb77b566b', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:12:17.633498 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-63f2d799-a7ef-4fa0-bf02-99f6ec9dcd11 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:17.641794 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-63f2d799-a7ef-4fa0-bf02-99f6ec9dcd11 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1681 microversion: 2.1 time: 0.244689 Jun 06 13:12:17.642453 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 224/467] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:17 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1681 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:17.648882 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c1779165-7a93-46f9-8dbd-cad1d0c48638 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:17.649499 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c1779165-7a93-46f9-8dbd-cad1d0c48638 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:17.656279 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1779165-7a93-46f9-8dbd-cad1d0c48638 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:17.656750 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1779165-7a93-46f9-8dbd-cad1d0c48638 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:17.657523 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1779165-7a93-46f9-8dbd-cad1d0c48638 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:17.658728 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1779165-7a93-46f9-8dbd-cad1d0c48638 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:17.804731 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c1779165-7a93-46f9-8dbd-cad1d0c48638 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:17.829775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c1779165-7a93-46f9-8dbd-cad1d0c48638 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1260 microversion: 2.1 time: 0.183559 Jun 06 13:12:17.830653 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 225/468] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:17 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1260 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:17.853713 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-adf4f1dc-857b-470b-a6be-4179616c501b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:17.856368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-adf4f1dc-857b-470b-a6be-4179616c501b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:17.862800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-adf4f1dc-857b-470b-a6be-4179616c501b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:17.863295 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-adf4f1dc-857b-470b-a6be-4179616c501b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:17.864226 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-adf4f1dc-857b-470b-a6be-4179616c501b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:17.864662 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-adf4f1dc-857b-470b-a6be-4179616c501b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:18.007065 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:12:18.007557 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:12:18.007920 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:12:18.008327 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:12:18.008739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:12:18.022210 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:18.022741 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:18.023814 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:18.024507 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:18.047663 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Getting quotas for project c6c440914e0f40e49b9fc8ab9f4b6f48. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:12:18.052304 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Getting quotas for user 593bba746dfc40dfbe768b4b9f0c78e3 and project c6c440914e0f40e49b9fc8ab9f4b6f48. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:12:18.066559 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:12:18.068951 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:12:18.097664 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-adf4f1dc-857b-470b-a6be-4179616c501b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:18.108674 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-adf4f1dc-857b-470b-a6be-4179616c501b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:18.110338 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-adf4f1dc-857b-470b-a6be-4179616c501b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:18.111516 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-adf4f1dc-857b-470b-a6be-4179616c501b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.262823 Jun 06 13:12:18.124391 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 226/469] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:17 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:18.129081 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-f6bbfb3c-526f-41b5-9292-77b91d9d0c2c req-0d648a3e-9c72-419b-a718-eaaba3fe3466 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "02dfda62-0a51-417a-807a-c653d5fc26db", "name": "network-vif-deleted", "tag": "8c71242d-a06b-44fd-b334-7c6b540ac882"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:18.137891 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-f6bbfb3c-526f-41b5-9292-77b91d9d0c2c req-0d648a3e-9c72-419b-a718-eaaba3fe3466 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:18.138367 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-f6bbfb3c-526f-41b5-9292-77b91d9d0c2c req-0d648a3e-9c72-419b-a718-eaaba3fe3466 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:18.150469 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-f6bbfb3c-526f-41b5-9292-77b91d9d0c2c req-0d648a3e-9c72-419b-a718-eaaba3fe3466 service nova] Creating event network-vif-deleted:8c71242d-a06b-44fd-b334-7c6b540ac882 for instance 02dfda62-0a51-417a-807a-c653d5fc26db on hv-cinder-75510 Jun 06 13:12:18.158127 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-f6bbfb3c-526f-41b5-9292-77b91d9d0c2c req-0d648a3e-9c72-419b-a718-eaaba3fe3466 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032491 Jun 06 13:12:18.158991 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 227/470] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:12:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:18.230674 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-51f54f9e-5641-40c1-8b1f-e588d797867f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:18.231819 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-51f54f9e-5641-40c1-8b1f-e588d797867f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:18.240937 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-51f54f9e-5641-40c1-8b1f-e588d797867f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:18.242775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-51f54f9e-5641-40c1-8b1f-e588d797867f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:18.242775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-51f54f9e-5641-40c1-8b1f-e588d797867f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:18.250013 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-51f54f9e-5641-40c1-8b1f-e588d797867f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:18.264305 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f3b00630-039b-4148-8848-864ff7f572dd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.893281 Jun 06 13:12:18.266203 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 244/471] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:12:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 896 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:12:18.280487 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-676a4750-e1b3-4764-ba58-02e3f7c24ea9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:18.281485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-676a4750-e1b3-4764-ba58-02e3f7c24ea9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:18.331678 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-51f54f9e-5641-40c1-8b1f-e588d797867f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lazy-loading 'flavor' on Instance uuid a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:12:18.374989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-676a4750-e1b3-4764-ba58-02e3f7c24ea9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:18.384772 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-676a4750-e1b3-4764-ba58-02e3f7c24ea9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1218 microversion: 2.1 time: 0.108902 Jun 06 13:12:18.385427 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 245/472] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:18 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1218 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:18.663458 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-12ff60ef-65ac-4668-964c-5252a5d88c86 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:18.664343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-12ff60ef-65ac-4668-964c-5252a5d88c86 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:18.673620 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12ff60ef-65ac-4668-964c-5252a5d88c86 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:18.674064 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12ff60ef-65ac-4668-964c-5252a5d88c86 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:18.675520 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12ff60ef-65ac-4668-964c-5252a5d88c86 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:18.675988 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12ff60ef-65ac-4668-964c-5252a5d88c86 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:18.709600 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-51f54f9e-5641-40c1-8b1f-e588d797867f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "POST /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/action" status: 200 len: 32 microversion: 2.1 time: 0.483860 Jun 06 13:12:18.715427 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 228/473] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:12:18 2022] POST /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/action => generated 32 bytes in 486 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 13:12:18.719583 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12ff60ef-65ac-4668-964c-5252a5d88c86 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:18.720035 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12ff60ef-65ac-4668-964c-5252a5d88c86 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:18.720477 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-12ff60ef-65ac-4668-964c-5252a5d88c86 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lazy-loading 'fault' on Instance uuid 02dfda62-0a51-417a-807a-c653d5fc26db {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:12:18.724952 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-82574dd9-9384-4fdb-af2b-ced7ef99caaf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:18.725652 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-82574dd9-9384-4fdb-af2b-ced7ef99caaf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:18.739273 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-82574dd9-9384-4fdb-af2b-ced7ef99caaf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:18.740052 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-82574dd9-9384-4fdb-af2b-ced7ef99caaf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:18.740980 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-82574dd9-9384-4fdb-af2b-ced7ef99caaf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:18.741566 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-82574dd9-9384-4fdb-af2b-ced7ef99caaf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:18.784618 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-12ff60ef-65ac-4668-964c-5252a5d88c86 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:18.796559 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-12ff60ef-65ac-4668-964c-5252a5d88c86 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1331 microversion: 2.1 time: 0.138222 Jun 06 13:12:18.797438 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 246/474] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:18 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1331 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:18.847154 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3cde41f4-298d-4c02-b5d1-04b5167ac11f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:18.847730 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3cde41f4-298d-4c02-b5d1-04b5167ac11f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:18.855974 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3cde41f4-298d-4c02-b5d1-04b5167ac11f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:18.856451 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3cde41f4-298d-4c02-b5d1-04b5167ac11f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:18.857204 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3cde41f4-298d-4c02-b5d1-04b5167ac11f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:18.857670 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3cde41f4-298d-4c02-b5d1-04b5167ac11f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:18.968306 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3cde41f4-298d-4c02-b5d1-04b5167ac11f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:18.980395 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-82574dd9-9384-4fdb-af2b-ced7ef99caaf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:18.988001 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3cde41f4-298d-4c02-b5d1-04b5167ac11f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1308 microversion: 2.1 time: 0.143913 Jun 06 13:12:18.989047 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 247/475] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:18 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1308 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:18.990267 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-82574dd9-9384-4fdb-af2b-ced7ef99caaf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.274635 Jun 06 13:12:18.999593 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 229/476] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:18 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 276 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:19.130044 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-53488b38-bba5-450f-8063-61e5ed702312 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:19.130783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-53488b38-bba5-450f-8063-61e5ed702312 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:19.137125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-53488b38-bba5-450f-8063-61e5ed702312 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:19.137702 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-53488b38-bba5-450f-8063-61e5ed702312 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:19.143377 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-53488b38-bba5-450f-8063-61e5ed702312 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:19.143377 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-53488b38-bba5-450f-8063-61e5ed702312 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:19.306891 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-53488b38-bba5-450f-8063-61e5ed702312 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:19.316870 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-53488b38-bba5-450f-8063-61e5ed702312 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:19.318611 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-53488b38-bba5-450f-8063-61e5ed702312 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:19.319948 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-53488b38-bba5-450f-8063-61e5ed702312 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.193954 Jun 06 13:12:19.320943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 248/477] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:19 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:19.401465 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b7e83245-6f2a-4d4b-993e-6bb51ca22fd9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:19.405604 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b7e83245-6f2a-4d4b-993e-6bb51ca22fd9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:19.410793 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b7e83245-6f2a-4d4b-993e-6bb51ca22fd9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:19.411236 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b7e83245-6f2a-4d4b-993e-6bb51ca22fd9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:19.412032 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b7e83245-6f2a-4d4b-993e-6bb51ca22fd9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:19.412461 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b7e83245-6f2a-4d4b-993e-6bb51ca22fd9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:19.479785 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b7e83245-6f2a-4d4b-993e-6bb51ca22fd9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:19.488865 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b7e83245-6f2a-4d4b-993e-6bb51ca22fd9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1222 microversion: 2.1 time: 0.091561 Jun 06 13:12:19.489433 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 230/478] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:19 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1222 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:19.814592 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dcfe4373-ee87-4ac9-8389-612f1696724c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:19.815841 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dcfe4373-ee87-4ac9-8389-612f1696724c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:19.828553 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcfe4373-ee87-4ac9-8389-612f1696724c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:19.829001 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcfe4373-ee87-4ac9-8389-612f1696724c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:19.829875 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcfe4373-ee87-4ac9-8389-612f1696724c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:19.830305 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcfe4373-ee87-4ac9-8389-612f1696724c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:19.868430 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcfe4373-ee87-4ac9-8389-612f1696724c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:19.869147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dcfe4373-ee87-4ac9-8389-612f1696724c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:19.869776 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-dcfe4373-ee87-4ac9-8389-612f1696724c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lazy-loading 'fault' on Instance uuid 02dfda62-0a51-417a-807a-c653d5fc26db {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:12:19.936586 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dcfe4373-ee87-4ac9-8389-612f1696724c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:19.946792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dcfe4373-ee87-4ac9-8389-612f1696724c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 200 len: 1331 microversion: 2.1 time: 0.136282 Jun 06 13:12:19.947714 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 249/479] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:19 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 1331 bytes in 138 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:20.009172 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-89b234b3-6bb6-4fb5-83c3-05aa8d6ef562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:20.010047 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-89b234b3-6bb6-4fb5-83c3-05aa8d6ef562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:20.018856 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6b4932df-7c29-43e3-9084-bdb303068606 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:20.022445 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89b234b3-6bb6-4fb5-83c3-05aa8d6ef562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:20.023046 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89b234b3-6bb6-4fb5-83c3-05aa8d6ef562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:20.023847 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6b4932df-7c29-43e3-9084-bdb303068606 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:20.024768 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89b234b3-6bb6-4fb5-83c3-05aa8d6ef562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:20.026030 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-89b234b3-6bb6-4fb5-83c3-05aa8d6ef562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:20.040686 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6b4932df-7c29-43e3-9084-bdb303068606 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:20.041713 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:20.044793 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6b4932df-7c29-43e3-9084-bdb303068606 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:20.047897 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6b4932df-7c29-43e3-9084-bdb303068606 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:20.048525 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6b4932df-7c29-43e3-9084-bdb303068606 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:20.196506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6b4932df-7c29-43e3-9084-bdb303068606 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:20.215231 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6b4932df-7c29-43e3-9084-bdb303068606 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1316 microversion: 2.1 time: 0.210927 Jun 06 13:12:20.231611 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 231/480] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:20 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1316 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:20.320267 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-89b234b3-6bb6-4fb5-83c3-05aa8d6ef562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:20.333846 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-89b234b3-6bb6-4fb5-83c3-05aa8d6ef562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.329346 Jun 06 13:12:20.335272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 250/481] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:20 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:20.348960 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4ed8f90d-ed0c-4a3e-81de-075778033ef4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:20.349783 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-4ed8f90d-ed0c-4a3e-81de-075778033ef4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:20.357212 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4ed8f90d-ed0c-4a3e-81de-075778033ef4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:20.357967 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4ed8f90d-ed0c-4a3e-81de-075778033ef4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:20.358904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4ed8f90d-ed0c-4a3e-81de-075778033ef4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:20.361499 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4ed8f90d-ed0c-4a3e-81de-075778033ef4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:20.506469 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-4ed8f90d-ed0c-4a3e-81de-075778033ef4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:20.508016 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a7684408-89dc-4637-945c-779d5392c26e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:20.509436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:20.516414 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a7684408-89dc-4637-945c-779d5392c26e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:20.518547 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-4ed8f90d-ed0c-4a3e-81de-075778033ef4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:20.520128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-4ed8f90d-ed0c-4a3e-81de-075778033ef4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:20.521337 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-4ed8f90d-ed0c-4a3e-81de-075778033ef4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1806 microversion: 2.20 time: 0.187004 Jun 06 13:12:20.521917 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 232/482] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:20 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1806 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:12:20.524121 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a7684408-89dc-4637-945c-779d5392c26e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:20.524627 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a7684408-89dc-4637-945c-779d5392c26e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:20.525403 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a7684408-89dc-4637-945c-779d5392c26e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:20.525836 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a7684408-89dc-4637-945c-779d5392c26e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:20.611680 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a7684408-89dc-4637-945c-779d5392c26e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:20.620792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a7684408-89dc-4637-945c-779d5392c26e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1270 microversion: 2.1 time: 0.118408 Jun 06 13:12:20.621746 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 251/483] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:20 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1270 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:20.970165 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b827e917-357a-4d70-9aef-578b91b82024 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:20.971034 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b827e917-357a-4d70-9aef-578b91b82024 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:20.978053 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b827e917-357a-4d70-9aef-578b91b82024 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:20.983231 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b827e917-357a-4d70-9aef-578b91b82024 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:20.983231 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b827e917-357a-4d70-9aef-578b91b82024 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:20.983231 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b827e917-357a-4d70-9aef-578b91b82024 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:20.993878 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-b827e917-357a-4d70-9aef-578b91b82024 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b827e917-357a-4d70-9aef-578b91b82024 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db HTTP/1.1 Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:12:20.995510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:12:20.997109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:12:20.997109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:12:20.997109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:12:20.997109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:12:20.997109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:12:20.997109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:12:20.997109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:12:20.997109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:12:20.997109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:12:20.997109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:12:20.997109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:12:20.997109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '02dfda62-0a51-417a-807a-c653d5fc26db'} Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:12:20.998031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:12:21.000807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:21.002313 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b827e917-357a-4d70-9aef-578b91b82024 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 404 to user: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:12:21.002313 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b827e917-357a-4d70-9aef-578b91b82024 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 404 len: 111 microversion: 2.1 time: 0.035285 Jun 06 13:12:21.002313 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 233/484] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:20 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:12:21.011387 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-41892cfc-e1f7-4f3c-9bf0-91509e2fd01b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '.version_select at 0x7f0efc101af0>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:21.011919 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fa0b2729-1176-46c6-a5d6-4879925b68c6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:21.011919 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-fa0b2729-1176-46c6-a5d6-4879925b68c6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:21.017002 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fa0b2729-1176-46c6-a5d6-4879925b68c6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:21.017451 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fa0b2729-1176-46c6-a5d6-4879925b68c6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:21.018312 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fa0b2729-1176-46c6-a5d6-4879925b68c6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:21.018753 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fa0b2729-1176-46c6-a5d6-4879925b68c6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:21.128155 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-fa0b2729-1176-46c6-a5d6-4879925b68c6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lazy-loading 'services' on Instance uuid 05c0144f-361b-4c15-813d-6c7b190ff600 {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:12:21.173034 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-41892cfc-e1f7-4f3c-9bf0-91509e2fd01b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-497649077" status: 202 len: 0 microversion: 2.1 time: 0.169595 Jun 06 13:12:21.183791 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 252/485] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Jun 6 13:12:21 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-497649077 => generated 0 bytes in 172 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:12:21.237820 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-16c40537-fb4a-48ca-b7e2-3bb7a851fee1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:21.238436 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-16c40537-fb4a-48ca-b7e2-3bb7a851fee1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:21.255618 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-16c40537-fb4a-48ca-b7e2-3bb7a851fee1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:21.257767 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-16c40537-fb4a-48ca-b7e2-3bb7a851fee1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:21.260000 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-16c40537-fb4a-48ca-b7e2-3bb7a851fee1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:21.260623 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-16c40537-fb4a-48ca-b7e2-3bb7a851fee1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:21.418292 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-fa0b2729-1176-46c6-a5d6-4879925b68c6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/os-volume_attachments/0f0b57a7-dc9b-49b9-94ce-e47b85f5a72c" status: 202 len: 0 microversion: 2.1 time: 0.413336 Jun 06 13:12:21.419903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 234/486] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 13:12:21 2022] DELETE /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/os-volume_attachments/0f0b57a7-dc9b-49b9-94ce-e47b85f5a72c => generated 0 bytes in 416 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:12:21.434827 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a5ab8241-0439-4280-9d6a-5aed47157b95 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:21.435782 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a5ab8241-0439-4280-9d6a-5aed47157b95 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:21.455253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5ab8241-0439-4280-9d6a-5aed47157b95 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:21.455766 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5ab8241-0439-4280-9d6a-5aed47157b95 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:21.456624 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5ab8241-0439-4280-9d6a-5aed47157b95 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:21.457065 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5ab8241-0439-4280-9d6a-5aed47157b95 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:21.740903 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-16c40537-fb4a-48ca-b7e2-3bb7a851fee1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:21.750142 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-16c40537-fb4a-48ca-b7e2-3bb7a851fee1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.519097 Jun 06 13:12:21.760013 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 253/487] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:21 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:21.767054 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cb60b55b-df23-4817-bd49-c794724be38f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:21.767700 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cb60b55b-df23-4817-bd49-c794724be38f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:21.784554 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cb60b55b-df23-4817-bd49-c794724be38f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:21.785220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cb60b55b-df23-4817-bd49-c794724be38f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:21.786182 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cb60b55b-df23-4817-bd49-c794724be38f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:21.786784 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cb60b55b-df23-4817-bd49-c794724be38f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:21.840520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a5ab8241-0439-4280-9d6a-5aed47157b95 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:21.854027 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a5ab8241-0439-4280-9d6a-5aed47157b95 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.431373 Jun 06 13:12:21.863114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 235/488] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:21 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 442 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:21.874233 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-779b2319-56e7-4795-9172-6feac69af6f2 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:21.875213 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-779b2319-56e7-4795-9172-6feac69af6f2 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:21.893531 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-779b2319-56e7-4795-9172-6feac69af6f2 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:21.893991 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-779b2319-56e7-4795-9172-6feac69af6f2 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:21.894765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-779b2319-56e7-4795-9172-6feac69af6f2 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:21.895202 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-779b2319-56e7-4795-9172-6feac69af6f2 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:22.068836 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-779b2319-56e7-4795-9172-6feac69af6f2 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:22.079650 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-779b2319-56e7-4795-9172-6feac69af6f2 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1276 microversion: 2.1 time: 0.214321 Jun 06 13:12:22.080643 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 236/489] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:21 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1276 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:22.103296 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cb60b55b-df23-4817-bd49-c794724be38f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:22.117225 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cb60b55b-df23-4817-bd49-c794724be38f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:22.118739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cb60b55b-df23-4817-bd49-c794724be38f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:22.120143 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cb60b55b-df23-4817-bd49-c794724be38f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1793 microversion: 2.20 time: 0.363247 Jun 06 13:12:22.120860 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 254/490] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:12:21 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1793 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:12:22.728816 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f94cf115-b83d-4baa-944e-4a77211f9ddb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:22.729295 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f94cf115-b83d-4baa-944e-4a77211f9ddb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:22.736571 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f94cf115-b83d-4baa-944e-4a77211f9ddb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:22.737008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f94cf115-b83d-4baa-944e-4a77211f9ddb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:22.737761 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f94cf115-b83d-4baa-944e-4a77211f9ddb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:22.738182 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f94cf115-b83d-4baa-944e-4a77211f9ddb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:22.768959 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-543ce566-9da4-4c86-8b19-4bf949e9ddb8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:22.769785 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-543ce566-9da4-4c86-8b19-4bf949e9ddb8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:22.783158 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-543ce566-9da4-4c86-8b19-4bf949e9ddb8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:22.786136 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-543ce566-9da4-4c86-8b19-4bf949e9ddb8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:22.787561 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-543ce566-9da4-4c86-8b19-4bf949e9ddb8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:22.788085 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-543ce566-9da4-4c86-8b19-4bf949e9ddb8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:22.829125 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-f94cf115-b83d-4baa-944e-4a77211f9ddb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lazy-loading 'services' on Instance uuid ec960d68-c9a5-4886-a3f3-07c63abf3cce {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:12:22.957026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-543ce566-9da4-4c86-8b19-4bf949e9ddb8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:22.965574 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-543ce566-9da4-4c86-8b19-4bf949e9ddb8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.201907 Jun 06 13:12:22.966418 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 255/491] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:22 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:22.976505 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e877929a-9aeb-4779-bcb5-c50a2a8e98b0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:22.977218 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e877929a-9aeb-4779-bcb5-c50a2a8e98b0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:22.984282 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e877929a-9aeb-4779-bcb5-c50a2a8e98b0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:22.984750 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e877929a-9aeb-4779-bcb5-c50a2a8e98b0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:22.985539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e877929a-9aeb-4779-bcb5-c50a2a8e98b0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:22.985982 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e877929a-9aeb-4779-bcb5-c50a2a8e98b0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:23.053109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f94cf115-b83d-4baa-944e-4a77211f9ddb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments/a5518ec4-1cc0-4e33-8a7a-97d829894e35" status: 202 len: 0 microversion: 2.1 time: 0.328020 Jun 06 13:12:23.053694 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 237/492] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 13:12:22 2022] DELETE /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments/a5518ec4-1cc0-4e33-8a7a-97d829894e35 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:12:23.067852 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5ee9e1d1-44ce-449c-bf41-ce0a6ffe67ce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:23.073836 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5ee9e1d1-44ce-449c-bf41-ce0a6ffe67ce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:23.075079 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5ee9e1d1-44ce-449c-bf41-ce0a6ffe67ce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:23.075521 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5ee9e1d1-44ce-449c-bf41-ce0a6ffe67ce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:23.076315 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5ee9e1d1-44ce-449c-bf41-ce0a6ffe67ce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:23.076990 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5ee9e1d1-44ce-449c-bf41-ce0a6ffe67ce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:23.117647 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5ee9e1d1-44ce-449c-bf41-ce0a6ffe67ce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.059300 Jun 06 13:12:23.120085 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 238/493] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:12:23 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments => generated 197 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:12:23.124329 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bf2849c4-470c-4a12-80d6-2310ea2ea851 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:23.125124 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-bf2849c4-470c-4a12-80d6-2310ea2ea851 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:23.131329 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bf2849c4-470c-4a12-80d6-2310ea2ea851 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:23.132095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bf2849c4-470c-4a12-80d6-2310ea2ea851 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:23.133236 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bf2849c4-470c-4a12-80d6-2310ea2ea851 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:23.133855 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bf2849c4-470c-4a12-80d6-2310ea2ea851 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:23.144990 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e877929a-9aeb-4779-bcb5-c50a2a8e98b0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:23.154069 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e877929a-9aeb-4779-bcb5-c50a2a8e98b0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.182214 Jun 06 13:12:23.155263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 256/494] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:22 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:23.205376 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-bf2849c4-470c-4a12-80d6-2310ea2ea851 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:23.213409 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-bf2849c4-470c-4a12-80d6-2310ea2ea851 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1276 microversion: 2.1 time: 0.093994 Jun 06 13:12:23.217342 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 239/495] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:23 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1276 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:23.984181 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2f5aece5-c528-49c5-8231-3b0ec0e3c59e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:23.984898 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2f5aece5-c528-49c5-8231-3b0ec0e3c59e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:23.991015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2f5aece5-c528-49c5-8231-3b0ec0e3c59e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:23.991483 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2f5aece5-c528-49c5-8231-3b0ec0e3c59e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:23.992274 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2f5aece5-c528-49c5-8231-3b0ec0e3c59e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:23.992705 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2f5aece5-c528-49c5-8231-3b0ec0e3c59e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:24.130319 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2f5aece5-c528-49c5-8231-3b0ec0e3c59e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:24.130502 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-7fc09da0-4cf7-4e79-82a2-c2151900e1a6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:24.131468 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-7fc09da0-4cf7-4e79-82a2-c2151900e1a6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:24.137996 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2f5aece5-c528-49c5-8231-3b0ec0e3c59e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.158181 Jun 06 13:12:24.138357 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7fc09da0-4cf7-4e79-82a2-c2151900e1a6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:24.143302 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7fc09da0-4cf7-4e79-82a2-c2151900e1a6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:24.143465 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 257/496] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:23 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:24.143581 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7fc09da0-4cf7-4e79-82a2-c2151900e1a6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:24.143581 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7fc09da0-4cf7-4e79-82a2-c2151900e1a6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:24.174580 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-954350f1-3aab-4005-90d9-ce3c99a33cd4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:24.180244 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-7fc09da0-4cf7-4e79-82a2-c2151900e1a6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.053900 Jun 06 13:12:24.181071 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-954350f1-3aab-4005-90d9-ce3c99a33cd4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:24.184651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 240/497] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:12:24 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments => generated 197 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:12:24.192486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-954350f1-3aab-4005-90d9-ce3c99a33cd4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:24.193268 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-954350f1-3aab-4005-90d9-ce3c99a33cd4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:24.194363 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-954350f1-3aab-4005-90d9-ce3c99a33cd4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:24.194987 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-954350f1-3aab-4005-90d9-ce3c99a33cd4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:24.230897 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3848e024-5d64-44e8-87f5-e4a25446d75d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:24.231504 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3848e024-5d64-44e8-87f5-e4a25446d75d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:24.237692 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3848e024-5d64-44e8-87f5-e4a25446d75d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:24.238131 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3848e024-5d64-44e8-87f5-e4a25446d75d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:24.238890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3848e024-5d64-44e8-87f5-e4a25446d75d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:24.239317 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3848e024-5d64-44e8-87f5-e4a25446d75d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:24.332978 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3848e024-5d64-44e8-87f5-e4a25446d75d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:24.340380 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3848e024-5d64-44e8-87f5-e4a25446d75d tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1276 microversion: 2.1 time: 0.113147 Jun 06 13:12:24.340951 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 241/498] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:24 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1276 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:24.363228 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-954350f1-3aab-4005-90d9-ce3c99a33cd4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:24.371818 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-954350f1-3aab-4005-90d9-ce3c99a33cd4 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.201910 Jun 06 13:12:24.372399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 258/499] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:24 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:25.154245 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5199bfa3-48fe-4c16-a54d-c3c29ca51ea5 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:25.155390 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5199bfa3-48fe-4c16-a54d-c3c29ca51ea5 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:25.162495 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5199bfa3-48fe-4c16-a54d-c3c29ca51ea5 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:25.162864 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5199bfa3-48fe-4c16-a54d-c3c29ca51ea5 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:25.163748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5199bfa3-48fe-4c16-a54d-c3c29ca51ea5 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:25.164195 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5199bfa3-48fe-4c16-a54d-c3c29ca51ea5 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:25.193985 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fa2f9984-a808-46b9-9db3-64a53c951cec tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:25.196146 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fa2f9984-a808-46b9-9db3-64a53c951cec tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:25.204601 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa2f9984-a808-46b9-9db3-64a53c951cec tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:25.205191 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa2f9984-a808-46b9-9db3-64a53c951cec tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:25.205976 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa2f9984-a808-46b9-9db3-64a53c951cec tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:25.207281 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa2f9984-a808-46b9-9db3-64a53c951cec tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:25.244743 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fa2f9984-a808-46b9-9db3-64a53c951cec tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.056125 Jun 06 13:12:25.245475 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 259/500] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:12:25 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments => generated 197 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:12:25.304272 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5199bfa3-48fe-4c16-a54d-c3c29ca51ea5 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:25.312361 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5199bfa3-48fe-4c16-a54d-c3c29ca51ea5 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.161762 Jun 06 13:12:25.313534 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 242/501] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:25 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:25.356682 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fb01cf83-9868-4704-80a6-f48689dc6608 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:25.357389 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fb01cf83-9868-4704-80a6-f48689dc6608 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:25.364111 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fb01cf83-9868-4704-80a6-f48689dc6608 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:25.364557 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fb01cf83-9868-4704-80a6-f48689dc6608 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:25.365319 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fb01cf83-9868-4704-80a6-f48689dc6608 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:25.365753 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fb01cf83-9868-4704-80a6-f48689dc6608 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:25.390545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a1a680e7-69e0-4448-94e4-96742f3dee99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:25.391220 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a1a680e7-69e0-4448-94e4-96742f3dee99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:25.397366 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a1a680e7-69e0-4448-94e4-96742f3dee99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:25.397819 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a1a680e7-69e0-4448-94e4-96742f3dee99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:25.398588 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a1a680e7-69e0-4448-94e4-96742f3dee99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:25.399025 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a1a680e7-69e0-4448-94e4-96742f3dee99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:25.433024 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fb01cf83-9868-4704-80a6-f48689dc6608 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:25.441273 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fb01cf83-9868-4704-80a6-f48689dc6608 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1276 microversion: 2.1 time: 0.088423 Jun 06 13:12:25.441977 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 260/502] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:25 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1276 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:25.541327 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a1a680e7-69e0-4448-94e4-96742f3dee99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:25.554152 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a1a680e7-69e0-4448-94e4-96742f3dee99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.168046 Jun 06 13:12:25.555576 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 243/503] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:25 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:26.257131 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-29089d6a-9d72-43d5-a57e-b86e4b72c4b7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:26.258570 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-29089d6a-9d72-43d5-a57e-b86e4b72c4b7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:26.266020 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-29089d6a-9d72-43d5-a57e-b86e4b72c4b7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:26.266595 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-29089d6a-9d72-43d5-a57e-b86e4b72c4b7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:26.267472 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-29089d6a-9d72-43d5-a57e-b86e4b72c4b7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:26.268281 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-29089d6a-9d72-43d5-a57e-b86e4b72c4b7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:26.300232 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-29089d6a-9d72-43d5-a57e-b86e4b72c4b7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047002 Jun 06 13:12:26.304502 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 261/504] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:12:26 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:26.330199 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d782ba44-1043-47f9-add8-5c6128af06bf tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:26.331429 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d782ba44-1043-47f9-add8-5c6128af06bf tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:26.337150 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=4 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:26.338544 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=94,nova_api:UPDATE=1,nova_api:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:26.340540 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d782ba44-1043-47f9-add8-5c6128af06bf tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:26.341147 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d782ba44-1043-47f9-add8-5c6128af06bf tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:26.342193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d782ba44-1043-47f9-add8-5c6128af06bf tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:26.343326 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d782ba44-1043-47f9-add8-5c6128af06bf tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:26.458333 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0f949b7d-1e15-49c3-a15c-e8a14f934505 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:26.458941 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0f949b7d-1e15-49c3-a15c-e8a14f934505 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:26.460911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:26.465703 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0f949b7d-1e15-49c3-a15c-e8a14f934505 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:26.466148 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0f949b7d-1e15-49c3-a15c-e8a14f934505 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:26.466942 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0f949b7d-1e15-49c3-a15c-e8a14f934505 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:26.468269 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0f949b7d-1e15-49c3-a15c-e8a14f934505 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:26.493285 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d782ba44-1043-47f9-add8-5c6128af06bf tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:26.502412 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d782ba44-1043-47f9-add8-5c6128af06bf tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.176220 Jun 06 13:12:26.511758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 244/505] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:26 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:26.538855 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0f949b7d-1e15-49c3-a15c-e8a14f934505 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:26.547187 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0f949b7d-1e15-49c3-a15c-e8a14f934505 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1276 microversion: 2.1 time: 0.092719 Jun 06 13:12:26.547811 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 262/506] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:26 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:26.573672 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cef2ba93-99b5-4f2c-9399-807769a5c4eb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:26.574717 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-cef2ba93-99b5-4f2c-9399-807769a5c4eb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:26.584628 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cef2ba93-99b5-4f2c-9399-807769a5c4eb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:26.595910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cef2ba93-99b5-4f2c-9399-807769a5c4eb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:26.596956 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cef2ba93-99b5-4f2c-9399-807769a5c4eb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:26.597483 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cef2ba93-99b5-4f2c-9399-807769a5c4eb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:26.731450 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cef2ba93-99b5-4f2c-9399-807769a5c4eb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:26.740064 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cef2ba93-99b5-4f2c-9399-807769a5c4eb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.170892 Jun 06 13:12:26.740613 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 245/507] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:26 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:27.313144 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8933431a-be1e-4a08-8c69-864925963ef9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:27.313947 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8933431a-be1e-4a08-8c69-864925963ef9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:27.321928 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8933431a-be1e-4a08-8c69-864925963ef9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:27.322536 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8933431a-be1e-4a08-8c69-864925963ef9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:27.324124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8933431a-be1e-4a08-8c69-864925963ef9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:27.325058 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8933431a-be1e-4a08-8c69-864925963ef9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:27.362718 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8933431a-be1e-4a08-8c69-864925963ef9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.054255 Jun 06 13:12:27.367268 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 263/508] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:12:27 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments => generated 197 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:27.520282 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-283bf5df-f368-42bb-bd2a-8e1967c9f269 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:27.521098 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-283bf5df-f368-42bb-bd2a-8e1967c9f269 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:27.528125 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-283bf5df-f368-42bb-bd2a-8e1967c9f269 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:27.528920 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-283bf5df-f368-42bb-bd2a-8e1967c9f269 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:27.529937 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-283bf5df-f368-42bb-bd2a-8e1967c9f269 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:27.530835 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-283bf5df-f368-42bb-bd2a-8e1967c9f269 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:27.564852 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-60f3a7e9-a7db-4d88-bbfc-5c0fe26c7455 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:27.565374 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-60f3a7e9-a7db-4d88-bbfc-5c0fe26c7455 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:27.571952 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-60f3a7e9-a7db-4d88-bbfc-5c0fe26c7455 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:27.572398 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-60f3a7e9-a7db-4d88-bbfc-5c0fe26c7455 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:27.573169 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-60f3a7e9-a7db-4d88-bbfc-5c0fe26c7455 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:27.573608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-60f3a7e9-a7db-4d88-bbfc-5c0fe26c7455 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:27.643639 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-60f3a7e9-a7db-4d88-bbfc-5c0fe26c7455 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:27.651945 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-60f3a7e9-a7db-4d88-bbfc-5c0fe26c7455 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1276 microversion: 2.1 time: 0.091776 Jun 06 13:12:27.652756 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 264/509] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:27 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1276 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:27.728837 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-283bf5df-f368-42bb-bd2a-8e1967c9f269 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:27.738012 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-283bf5df-f368-42bb-bd2a-8e1967c9f269 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.221474 Jun 06 13:12:27.738639 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 246/510] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:27 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:27.757636 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b2f2b432-9830-456c-a3f5-c19b0511b75b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:27.758243 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b2f2b432-9830-456c-a3f5-c19b0511b75b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:27.764487 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b2f2b432-9830-456c-a3f5-c19b0511b75b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:27.765176 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b2f2b432-9830-456c-a3f5-c19b0511b75b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:27.766141 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b2f2b432-9830-456c-a3f5-c19b0511b75b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:27.766580 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b2f2b432-9830-456c-a3f5-c19b0511b75b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:27.943518 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b2f2b432-9830-456c-a3f5-c19b0511b75b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:27.952870 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b2f2b432-9830-456c-a3f5-c19b0511b75b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.198988 Jun 06 13:12:27.953446 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 265/511] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:27 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:28.374656 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4fb25af0-6cf2-47ee-989c-74b04005bd8a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:28.375784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-4fb25af0-6cf2-47ee-989c-74b04005bd8a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:28.382280 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4fb25af0-6cf2-47ee-989c-74b04005bd8a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:28.382807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4fb25af0-6cf2-47ee-989c-74b04005bd8a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:28.383765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4fb25af0-6cf2-47ee-989c-74b04005bd8a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:28.384367 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4fb25af0-6cf2-47ee-989c-74b04005bd8a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:28.419557 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-4fb25af0-6cf2-47ee-989c-74b04005bd8a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048945 Jun 06 13:12:28.420130 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 247/512] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:12:28 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:28.670216 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-baf311c6-d17c-475b-8e12-b9adfe4ba3d6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:28.671565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-baf311c6-d17c-475b-8e12-b9adfe4ba3d6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:28.673807 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:28.675223 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=16 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:28.680217 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-baf311c6-d17c-475b-8e12-b9adfe4ba3d6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:28.680661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-baf311c6-d17c-475b-8e12-b9adfe4ba3d6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:28.681426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-baf311c6-d17c-475b-8e12-b9adfe4ba3d6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:28.681850 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-baf311c6-d17c-475b-8e12-b9adfe4ba3d6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:28.746585 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-baf311c6-d17c-475b-8e12-b9adfe4ba3d6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:28.755827 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-db4e49cc-2982-4caa-a0e6-620e7dc6f90d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:28.756368 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-baf311c6-d17c-475b-8e12-b9adfe4ba3d6 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1276 microversion: 2.1 time: 0.089854 Jun 06 13:12:28.756464 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-db4e49cc-2982-4caa-a0e6-620e7dc6f90d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:28.757039 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 266/513] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:28 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1276 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:28.762597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-db4e49cc-2982-4caa-a0e6-620e7dc6f90d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:28.763045 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-db4e49cc-2982-4caa-a0e6-620e7dc6f90d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:28.763833 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-db4e49cc-2982-4caa-a0e6-620e7dc6f90d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:28.764271 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-db4e49cc-2982-4caa-a0e6-620e7dc6f90d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:28.911793 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-db4e49cc-2982-4caa-a0e6-620e7dc6f90d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:28.914318 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:INSERT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:28.934787 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-db4e49cc-2982-4caa-a0e6-620e7dc6f90d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.182699 Jun 06 13:12:28.945024 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 248/514] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:28 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:28.974735 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-624aefc1-9e0f-42f2-a71d-21c163bb4c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:28.975488 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-624aefc1-9e0f-42f2-a71d-21c163bb4c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:28.982711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-624aefc1-9e0f-42f2-a71d-21c163bb4c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:28.983200 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-624aefc1-9e0f-42f2-a71d-21c163bb4c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:28.988279 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-624aefc1-9e0f-42f2-a71d-21c163bb4c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:28.988279 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-624aefc1-9e0f-42f2-a71d-21c163bb4c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:29.141436 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-624aefc1-9e0f-42f2-a71d-21c163bb4c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:29.143650 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:29.150243 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-624aefc1-9e0f-42f2-a71d-21c163bb4c49 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.180184 Jun 06 13:12:29.150811 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 267/515] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:28 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:29.431546 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-18bfce46-62c7-4a13-bf9d-2fe1cab479b9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:29.432528 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-18bfce46-62c7-4a13-bf9d-2fe1cab479b9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:29.440072 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-18bfce46-62c7-4a13-bf9d-2fe1cab479b9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:29.440464 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-18bfce46-62c7-4a13-bf9d-2fe1cab479b9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:29.441226 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-18bfce46-62c7-4a13-bf9d-2fe1cab479b9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:29.441662 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-18bfce46-62c7-4a13-bf9d-2fe1cab479b9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:29.472031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-18bfce46-62c7-4a13-bf9d-2fe1cab479b9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044437 Jun 06 13:12:29.472587 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 249/516] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:12:29 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:29.774538 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6831bfdd-b2f4-474f-93d9-16305a2b29ec tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:29.775069 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6831bfdd-b2f4-474f-93d9-16305a2b29ec tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:29.782186 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6831bfdd-b2f4-474f-93d9-16305a2b29ec tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:29.782631 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6831bfdd-b2f4-474f-93d9-16305a2b29ec tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:29.783378 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6831bfdd-b2f4-474f-93d9-16305a2b29ec tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:29.783836 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6831bfdd-b2f4-474f-93d9-16305a2b29ec tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:29.844241 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6831bfdd-b2f4-474f-93d9-16305a2b29ec tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:29.851592 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6831bfdd-b2f4-474f-93d9-16305a2b29ec tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1276 microversion: 2.1 time: 0.081040 Jun 06 13:12:29.852159 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 268/517] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:29 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1276 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:29.952769 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d0781c98-2303-4707-b5bd-69bb786db7c8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:29.953377 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d0781c98-2303-4707-b5bd-69bb786db7c8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:29.959936 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d0781c98-2303-4707-b5bd-69bb786db7c8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:29.960379 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d0781c98-2303-4707-b5bd-69bb786db7c8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:29.961174 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d0781c98-2303-4707-b5bd-69bb786db7c8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:29.961627 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d0781c98-2303-4707-b5bd-69bb786db7c8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:30.091571 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d0781c98-2303-4707-b5bd-69bb786db7c8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:30.099493 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d0781c98-2303-4707-b5bd-69bb786db7c8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.150772 Jun 06 13:12:30.100071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 250/518] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:29 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:30.168789 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1fa8e15e-dea2-4b41-a8fa-927c2cc798a3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:30.169518 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1fa8e15e-dea2-4b41-a8fa-927c2cc798a3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:30.176679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1fa8e15e-dea2-4b41-a8fa-927c2cc798a3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:30.177874 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1fa8e15e-dea2-4b41-a8fa-927c2cc798a3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:30.177992 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1fa8e15e-dea2-4b41-a8fa-927c2cc798a3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:30.178418 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1fa8e15e-dea2-4b41-a8fa-927c2cc798a3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:30.348118 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1fa8e15e-dea2-4b41-a8fa-927c2cc798a3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:30.360810 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1fa8e15e-dea2-4b41-a8fa-927c2cc798a3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.196194 Jun 06 13:12:30.370822 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 269/519] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:30 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:30.484325 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2a10c60a-c4ff-4d6f-91b2-298447ddbb42 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:30.485266 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2a10c60a-c4ff-4d6f-91b2-298447ddbb42 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:30.491375 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2a10c60a-c4ff-4d6f-91b2-298447ddbb42 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:30.492059 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2a10c60a-c4ff-4d6f-91b2-298447ddbb42 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:30.496656 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2a10c60a-c4ff-4d6f-91b2-298447ddbb42 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:30.496656 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2a10c60a-c4ff-4d6f-91b2-298447ddbb42 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:30.535104 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2a10c60a-c4ff-4d6f-91b2-298447ddbb42 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055177 Jun 06 13:12:30.539130 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 251/520] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:12:30 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:30.868874 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bd8f2389-17d4-4c52-bbdc-4ca05cebbfa5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:30.869504 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bd8f2389-17d4-4c52-bbdc-4ca05cebbfa5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:30.876475 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bd8f2389-17d4-4c52-bbdc-4ca05cebbfa5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:30.876976 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bd8f2389-17d4-4c52-bbdc-4ca05cebbfa5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:30.877731 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bd8f2389-17d4-4c52-bbdc-4ca05cebbfa5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:30.878155 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bd8f2389-17d4-4c52-bbdc-4ca05cebbfa5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:30.946769 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bd8f2389-17d4-4c52-bbdc-4ca05cebbfa5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:30.955943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bd8f2389-17d4-4c52-bbdc-4ca05cebbfa5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1276 microversion: 2.1 time: 0.090874 Jun 06 13:12:30.964339 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 270/521] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:30 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1276 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:31.117570 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b039123a-906a-4d5c-a708-573c3fd23879 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:31.118213 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b039123a-906a-4d5c-a708-573c3fd23879 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:31.128016 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b039123a-906a-4d5c-a708-573c3fd23879 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:31.128458 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b039123a-906a-4d5c-a708-573c3fd23879 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:31.134692 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b039123a-906a-4d5c-a708-573c3fd23879 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:31.135272 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b039123a-906a-4d5c-a708-573c3fd23879 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:31.219104 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1d5462df-f940-4a98-981d-2c0e66c7cb85 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:31.232704 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d5462df-f940-4a98-981d-2c0e66c7cb85 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:31.248916 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d5462df-f940-4a98-981d-2c0e66c7cb85 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:31.284994 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1d5462df-f940-4a98-981d-2c0e66c7cb85 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Going to try to stop instance {{(pid=118133) force_stop /opt/stack/nova/nova/compute/api.py:2707}} Jun 06 13:12:31.431101 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b039123a-906a-4d5c-a708-573c3fd23879 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:31.442367 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b039123a-906a-4d5c-a708-573c3fd23879 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.328611 Jun 06 13:12:31.451703 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 252/522] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:31 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:31.463775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-63881234-06a8-48b3-b9d8-12a9ceaccfbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:31.464459 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-63881234-06a8-48b3-b9d8-12a9ceaccfbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:31.472860 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-63881234-06a8-48b3-b9d8-12a9ceaccfbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:31.473604 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-63881234-06a8-48b3-b9d8-12a9ceaccfbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:31.474472 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-63881234-06a8-48b3-b9d8-12a9ceaccfbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:31.475123 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-63881234-06a8-48b3-b9d8-12a9ceaccfbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:31.514124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1d5462df-f940-4a98-981d-2c0e66c7cb85 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "POST /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/action" status: 202 len: 0 microversion: 2.1 time: 0.312205 Jun 06 13:12:31.514124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 271/523] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:12:31 2022] POST /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/action => generated 0 bytes in 317 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:12:31.521453 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-a5996927-5438-4a47-a081-b2c08f99eaf7 req-f41655f4-a8ce-4822-a2dc-66e14b067d83 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87090e23-8967-41e3-93f5-2c475fe348cf", "tag": "f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:31.532554 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-a5996927-5438-4a47-a081-b2c08f99eaf7 req-f41655f4-a8ce-4822-a2dc-66e14b067d83 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:31.533666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-a5996927-5438-4a47-a081-b2c08f99eaf7 req-f41655f4-a8ce-4822-a2dc-66e14b067d83 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:31.553722 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-a5996927-5438-4a47-a081-b2c08f99eaf7 req-f41655f4-a8ce-4822-a2dc-66e14b067d83 service nova] Creating event network-changed:f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb for instance 87090e23-8967-41e3-93f5-2c475fe348cf on hv-cinder-75510 Jun 06 13:12:31.565180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-a5996927-5438-4a47-a081-b2c08f99eaf7 req-f41655f4-a8ce-4822-a2dc-66e14b067d83 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.047886 Jun 06 13:12:31.566358 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 272/524] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:12:31 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:31.577811 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6940c840-da4e-4499-8378-1fe13999aab2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:31.585766 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6940c840-da4e-4499-8378-1fe13999aab2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:31.599380 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6940c840-da4e-4499-8378-1fe13999aab2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:31.604899 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6940c840-da4e-4499-8378-1fe13999aab2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:31.606471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6940c840-da4e-4499-8378-1fe13999aab2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:31.607065 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6940c840-da4e-4499-8378-1fe13999aab2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:31.680297 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-63881234-06a8-48b3-b9d8-12a9ceaccfbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:31.691997 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-63881234-06a8-48b3-b9d8-12a9ceaccfbe tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.231064 Jun 06 13:12:31.691997 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 253/525] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:31 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:31.697599 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b92b4496-20ca-40c0-b8a2-ab15614f0a34 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:31.698527 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b92b4496-20ca-40c0-b8a2-ab15614f0a34 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:31.706479 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b92b4496-20ca-40c0-b8a2-ab15614f0a34 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:31.707203 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b92b4496-20ca-40c0-b8a2-ab15614f0a34 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:31.717815 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b92b4496-20ca-40c0-b8a2-ab15614f0a34 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:31.722409 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b92b4496-20ca-40c0-b8a2-ab15614f0a34 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:31.769608 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b92b4496-20ca-40c0-b8a2-ab15614f0a34 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.076356 Jun 06 13:12:31.774130 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 254/526] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:12:31 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments => generated 197 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:31.801198 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6940c840-da4e-4499-8378-1fe13999aab2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:31.808886 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6940c840-da4e-4499-8378-1fe13999aab2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1679 microversion: 2.1 time: 0.239843 Jun 06 13:12:31.809506 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 273/527] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:31 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1679 bytes in 242 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:31.974178 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d7c2b161-5f04-4d58-8a71-cc6923d2d4fd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:31.974788 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d7c2b161-5f04-4d58-8a71-cc6923d2d4fd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:31.981160 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d7c2b161-5f04-4d58-8a71-cc6923d2d4fd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:31.981722 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d7c2b161-5f04-4d58-8a71-cc6923d2d4fd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:31.982629 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d7c2b161-5f04-4d58-8a71-cc6923d2d4fd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:31.983066 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d7c2b161-5f04-4d58-8a71-cc6923d2d4fd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:32.188115 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d7c2b161-5f04-4d58-8a71-cc6923d2d4fd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:32.196538 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d7c2b161-5f04-4d58-8a71-cc6923d2d4fd tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1318 microversion: 2.1 time: 0.226830 Jun 06 13:12:32.197204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 255/528] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:31 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1318 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:32.460933 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3d441c21-7a0d-48f7-9beb-0485ce542ab1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:32.461666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3d441c21-7a0d-48f7-9beb-0485ce542ab1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:32.469995 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3d441c21-7a0d-48f7-9beb-0485ce542ab1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:32.470511 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3d441c21-7a0d-48f7-9beb-0485ce542ab1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:32.471338 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3d441c21-7a0d-48f7-9beb-0485ce542ab1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:32.472006 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3d441c21-7a0d-48f7-9beb-0485ce542ab1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:32.673277 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3d441c21-7a0d-48f7-9beb-0485ce542ab1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:32.681090 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3d441c21-7a0d-48f7-9beb-0485ce542ab1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.223953 Jun 06 13:12:32.682524 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 274/529] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:32 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:32.708421 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1383c3bb-9b25-42db-bb10-1cc7f08b0cc7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:32.711254 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1383c3bb-9b25-42db-bb10-1cc7f08b0cc7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:32.714930 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1383c3bb-9b25-42db-bb10-1cc7f08b0cc7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:32.715372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1383c3bb-9b25-42db-bb10-1cc7f08b0cc7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:32.716152 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1383c3bb-9b25-42db-bb10-1cc7f08b0cc7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:32.716581 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1383c3bb-9b25-42db-bb10-1cc7f08b0cc7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:32.781947 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-98bd6f03-7fda-47ea-bcde-b527f76590eb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:32.783134 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-98bd6f03-7fda-47ea-bcde-b527f76590eb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:32.789158 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-98bd6f03-7fda-47ea-bcde-b527f76590eb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:32.789594 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-98bd6f03-7fda-47ea-bcde-b527f76590eb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:32.790345 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-98bd6f03-7fda-47ea-bcde-b527f76590eb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:32.790771 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-98bd6f03-7fda-47ea-bcde-b527f76590eb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:32.820104 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-98bd6f03-7fda-47ea-bcde-b527f76590eb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.042289 Jun 06 13:12:32.825167 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 275/530] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:12:32 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 13:12:32.830309 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f4dbf9af-6243-476b-9d2c-d09e8b20fd7a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:32.830905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f4dbf9af-6243-476b-9d2c-d09e8b20fd7a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:32.837693 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f4dbf9af-6243-476b-9d2c-d09e8b20fd7a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:32.838234 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f4dbf9af-6243-476b-9d2c-d09e8b20fd7a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:32.839085 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f4dbf9af-6243-476b-9d2c-d09e8b20fd7a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:32.839864 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f4dbf9af-6243-476b-9d2c-d09e8b20fd7a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:32.862761 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1383c3bb-9b25-42db-bb10-1cc7f08b0cc7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:32.871643 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1383c3bb-9b25-42db-bb10-1cc7f08b0cc7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.166991 Jun 06 13:12:32.872598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 256/531] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:32 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:32.892345 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c6d6f012-b5b8-4aee-96dc-b8507ad068c1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:32.892911 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c6d6f012-b5b8-4aee-96dc-b8507ad068c1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:32.898952 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c6d6f012-b5b8-4aee-96dc-b8507ad068c1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:32.899457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c6d6f012-b5b8-4aee-96dc-b8507ad068c1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:32.900295 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c6d6f012-b5b8-4aee-96dc-b8507ad068c1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:32.900791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c6d6f012-b5b8-4aee-96dc-b8507ad068c1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:32.928668 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c6d6f012-b5b8-4aee-96dc-b8507ad068c1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Going to try to terminate instance {{(pid=118134) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:12:32.979805 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f4dbf9af-6243-476b-9d2c-d09e8b20fd7a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:32.988325 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f4dbf9af-6243-476b-9d2c-d09e8b20fd7a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1679 microversion: 2.1 time: 0.162141 Jun 06 13:12:32.988902 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 276/532] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:32 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1679 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:33.184454 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c6d6f012-b5b8-4aee-96dc-b8507ad068c1 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 204 len: 0 microversion: 2.1 time: 0.296218 Jun 06 13:12:33.185044 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 257/533] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:12:32 2022] DELETE /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 0 bytes in 298 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:12:33.193980 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-03e5e9be-7510-4716-a0cd-606c10fb227c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:33.194606 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-03e5e9be-7510-4716-a0cd-606c10fb227c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:33.201443 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03e5e9be-7510-4716-a0cd-606c10fb227c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:33.201898 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03e5e9be-7510-4716-a0cd-606c10fb227c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:33.203571 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03e5e9be-7510-4716-a0cd-606c10fb227c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:33.204088 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03e5e9be-7510-4716-a0cd-606c10fb227c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:33.214718 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c7c4d98a-28a0-4139-ba49-1b885982fa82 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:33.215413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c7c4d98a-28a0-4139-ba49-1b885982fa82 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:33.221840 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c7c4d98a-28a0-4139-ba49-1b885982fa82 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:33.222295 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c7c4d98a-28a0-4139-ba49-1b885982fa82 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:33.223048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c7c4d98a-28a0-4139-ba49-1b885982fa82 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:33.223501 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c7c4d98a-28a0-4139-ba49-1b885982fa82 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:33.635933 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-03e5e9be-7510-4716-a0cd-606c10fb227c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:33.643988 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-03e5e9be-7510-4716-a0cd-606c10fb227c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1683 microversion: 2.1 time: 0.453882 Jun 06 13:12:33.644559 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 277/534] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:33 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1683 bytes in 455 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:33.644719 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c7c4d98a-28a0-4139-ba49-1b885982fa82 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:33.648951 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-45b1c270-6c50-4a43-b313-f44d63da8cd9 req-7b55c5e1-6fb0-4978-a667-722c64830c15 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c80076dd-2d71-451c-b869-d14a0f507ac7", "tag": "22c6e2ec-7fcf-457c-991b-931ea9ea289f"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:33.655484 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c7c4d98a-28a0-4139-ba49-1b885982fa82 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1318 microversion: 2.1 time: 0.444809 Jun 06 13:12:33.656799 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 258/535] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:33 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1318 bytes in 447 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:33.657795 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-45b1c270-6c50-4a43-b313-f44d63da8cd9 req-7b55c5e1-6fb0-4978-a667-722c64830c15 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:33.658229 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-45b1c270-6c50-4a43-b313-f44d63da8cd9 req-7b55c5e1-6fb0-4978-a667-722c64830c15 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:33.669004 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-45b1c270-6c50-4a43-b313-f44d63da8cd9 req-7b55c5e1-6fb0-4978-a667-722c64830c15 service nova] Creating event network-changed:22c6e2ec-7fcf-457c-991b-931ea9ea289f for instance c80076dd-2d71-451c-b869-d14a0f507ac7 on hv-cinder-75510 Jun 06 13:12:33.681823 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-45b1c270-6c50-4a43-b313-f44d63da8cd9 req-7b55c5e1-6fb0-4978-a667-722c64830c15 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036022 Jun 06 13:12:33.687333 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 278/536] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:12:33 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:33.698647 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-74ba9a0f-18cc-4473-ab79-78e8256dad39 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:33.699285 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-74ba9a0f-18cc-4473-ab79-78e8256dad39 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:33.705838 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-74ba9a0f-18cc-4473-ab79-78e8256dad39 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:33.706287 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-74ba9a0f-18cc-4473-ab79-78e8256dad39 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:33.707046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-74ba9a0f-18cc-4473-ab79-78e8256dad39 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:33.707483 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-74ba9a0f-18cc-4473-ab79-78e8256dad39 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:33.901899 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-773d88fb-8812-4982-bad5-a8f44a4453e5 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:33.902771 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-773d88fb-8812-4982-bad5-a8f44a4453e5 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:33.912471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-773d88fb-8812-4982-bad5-a8f44a4453e5 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:33.912988 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-773d88fb-8812-4982-bad5-a8f44a4453e5 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:33.913322 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-74ba9a0f-18cc-4473-ab79-78e8256dad39 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:33.913783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-773d88fb-8812-4982-bad5-a8f44a4453e5 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:33.917555 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-773d88fb-8812-4982-bad5-a8f44a4453e5 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:33.925692 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-74ba9a0f-18cc-4473-ab79-78e8256dad39 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.230828 Jun 06 13:12:33.926630 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 259/537] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:33 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:34.006101 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4acc41b5-a4ea-4e06-acc0-64db12e76de9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:34.010728 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-4acc41b5-a4ea-4e06-acc0-64db12e76de9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:34.017696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4acc41b5-a4ea-4e06-acc0-64db12e76de9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:34.018217 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4acc41b5-a4ea-4e06-acc0-64db12e76de9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:34.019081 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4acc41b5-a4ea-4e06-acc0-64db12e76de9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:34.019563 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4acc41b5-a4ea-4e06-acc0-64db12e76de9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:34.159727 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-773d88fb-8812-4982-bad5-a8f44a4453e5 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:34.167821 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-773d88fb-8812-4982-bad5-a8f44a4453e5 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.270064 Jun 06 13:12:34.168403 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 279/538] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:33 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:34.195062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-4acc41b5-a4ea-4e06-acc0-64db12e76de9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:34.202771 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-4acc41b5-a4ea-4e06-acc0-64db12e76de9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1679 microversion: 2.1 time: 0.200858 Jun 06 13:12:34.203335 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 260/539] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:34 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1679 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:34.661340 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-edbac570-4b62-4380-92ea-db6281ab3423 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:34.661900 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-edbac570-4b62-4380-92ea-db6281ab3423 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:34.668516 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-edbac570-4b62-4380-92ea-db6281ab3423 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:34.668982 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-edbac570-4b62-4380-92ea-db6281ab3423 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:34.669729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-edbac570-4b62-4380-92ea-db6281ab3423 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:34.670157 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-edbac570-4b62-4380-92ea-db6281ab3423 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:34.673907 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c6c1cf5b-7d9d-463a-8673-93404f473dc4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:34.674584 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c6c1cf5b-7d9d-463a-8673-93404f473dc4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:34.680643 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c6c1cf5b-7d9d-463a-8673-93404f473dc4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:34.681089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c6c1cf5b-7d9d-463a-8673-93404f473dc4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:34.681876 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c6c1cf5b-7d9d-463a-8673-93404f473dc4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:34.682311 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c6c1cf5b-7d9d-463a-8673-93404f473dc4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:34.865883 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-edbac570-4b62-4380-92ea-db6281ab3423 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:34.868941 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c6c1cf5b-7d9d-463a-8673-93404f473dc4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:34.873827 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-edbac570-4b62-4380-92ea-db6281ab3423 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1683 microversion: 2.1 time: 0.216377 Jun 06 13:12:34.880512 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 280/540] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:34 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1683 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:34.880634 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c6c1cf5b-7d9d-463a-8673-93404f473dc4 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1318 microversion: 2.1 time: 0.206895 Jun 06 13:12:34.880634 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 261/541] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:34 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1318 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:34.944074 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-99e82ec6-cacc-40aa-98c9-461e9d4b4080 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:34.944797 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-99e82ec6-cacc-40aa-98c9-461e9d4b4080 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:34.950953 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-99e82ec6-cacc-40aa-98c9-461e9d4b4080 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:34.951476 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-99e82ec6-cacc-40aa-98c9-461e9d4b4080 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:34.952335 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-99e82ec6-cacc-40aa-98c9-461e9d4b4080 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:34.953401 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-99e82ec6-cacc-40aa-98c9-461e9d4b4080 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:35.081642 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-99e82ec6-cacc-40aa-98c9-461e9d4b4080 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:35.089302 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-99e82ec6-cacc-40aa-98c9-461e9d4b4080 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.149187 Jun 06 13:12:35.089863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 281/542] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:34 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:35.184986 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-8b80e18f-2ece-44ad-bc20-d27976dfc48d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:35.185522 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8b80e18f-2ece-44ad-bc20-d27976dfc48d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:35.193080 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8b80e18f-2ece-44ad-bc20-d27976dfc48d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:35.193527 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8b80e18f-2ece-44ad-bc20-d27976dfc48d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:35.194277 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8b80e18f-2ece-44ad-bc20-d27976dfc48d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:35.194708 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8b80e18f-2ece-44ad-bc20-d27976dfc48d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:35.219612 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-52669296-c731-4c89-8834-bcd4c125b7b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:35.220358 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-52669296-c731-4c89-8834-bcd4c125b7b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:35.226475 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52669296-c731-4c89-8834-bcd4c125b7b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:35.226928 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52669296-c731-4c89-8834-bcd4c125b7b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:35.227729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52669296-c731-4c89-8834-bcd4c125b7b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:35.228168 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-52669296-c731-4c89-8834-bcd4c125b7b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:35.379883 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-8b80e18f-2ece-44ad-bc20-d27976dfc48d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:35.387938 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-8b80e18f-2ece-44ad-bc20-d27976dfc48d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.206778 Jun 06 13:12:35.388503 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 262/543] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:35 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:35.406279 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-52669296-c731-4c89-8834-bcd4c125b7b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:35.414046 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-52669296-c731-4c89-8834-bcd4c125b7b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1679 microversion: 2.1 time: 0.198310 Jun 06 13:12:35.414606 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 282/544] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:35 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1679 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:35.892972 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d531edbc-dd2d-40f4-a898-1c0558caee63 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:35.898120 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d531edbc-dd2d-40f4-a898-1c0558caee63 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:35.898257 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-18590b58-50a7-4776-87be-81857c6977d9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:35.898257 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-18590b58-50a7-4776-87be-81857c6977d9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:35.899765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d531edbc-dd2d-40f4-a898-1c0558caee63 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:35.900207 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d531edbc-dd2d-40f4-a898-1c0558caee63 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:35.901006 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-18590b58-50a7-4776-87be-81857c6977d9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:35.901127 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d531edbc-dd2d-40f4-a898-1c0558caee63 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:35.901453 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-18590b58-50a7-4776-87be-81857c6977d9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:35.901570 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d531edbc-dd2d-40f4-a898-1c0558caee63 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:35.902210 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-18590b58-50a7-4776-87be-81857c6977d9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:35.902644 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-18590b58-50a7-4776-87be-81857c6977d9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:36.095100 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-d531edbc-dd2d-40f4-a898-1c0558caee63 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:36.097548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:36.102133 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-18590b58-50a7-4776-87be-81857c6977d9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:36.103794 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d531edbc-dd2d-40f4-a898-1c0558caee63 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1683 microversion: 2.1 time: 0.215272 Jun 06 13:12:36.104577 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 263/545] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:35 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1683 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:36.109025 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b14eaadf-f550-45dc-89ed-ee092a7694e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:36.119764 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b14eaadf-f550-45dc-89ed-ee092a7694e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:36.119908 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-18590b58-50a7-4776-87be-81857c6977d9 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1318 microversion: 2.1 time: 0.220504 Jun 06 13:12:36.119908 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 283/546] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:35 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1318 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:36.120116 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b14eaadf-f550-45dc-89ed-ee092a7694e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:36.120116 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b14eaadf-f550-45dc-89ed-ee092a7694e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:36.120116 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b14eaadf-f550-45dc-89ed-ee092a7694e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:36.120116 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b14eaadf-f550-45dc-89ed-ee092a7694e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:36.244797 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b14eaadf-f550-45dc-89ed-ee092a7694e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:36.252646 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b14eaadf-f550-45dc-89ed-ee092a7694e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.147144 Jun 06 13:12:36.253200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 264/547] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:36 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:36.406700 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9a3dbd76-2c44-42cc-bed8-1dbd5829672a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:36.407317 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9a3dbd76-2c44-42cc-bed8-1dbd5829672a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:36.413748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a3dbd76-2c44-42cc-bed8-1dbd5829672a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:36.414201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a3dbd76-2c44-42cc-bed8-1dbd5829672a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:36.414968 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a3dbd76-2c44-42cc-bed8-1dbd5829672a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:36.415403 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a3dbd76-2c44-42cc-bed8-1dbd5829672a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:36.431473 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c1c1aa3a-3b85-414b-9d97-4e93e2844311 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:36.432107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c1c1aa3a-3b85-414b-9d97-4e93e2844311 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:36.439370 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1c1aa3a-3b85-414b-9d97-4e93e2844311 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:36.441555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1c1aa3a-3b85-414b-9d97-4e93e2844311 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:36.441555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1c1aa3a-3b85-414b-9d97-4e93e2844311 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:36.441555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1c1aa3a-3b85-414b-9d97-4e93e2844311 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:36.626186 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9a3dbd76-2c44-42cc-bed8-1dbd5829672a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:36.628601 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:36.631596 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c1c1aa3a-3b85-414b-9d97-4e93e2844311 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:36.639817 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c1c1aa3a-3b85-414b-9d97-4e93e2844311 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1679 microversion: 2.1 time: 0.212237 Jun 06 13:12:36.640388 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 265/548] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:36 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:36.644750 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9a3dbd76-2c44-42cc-bed8-1dbd5829672a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.242495 Jun 06 13:12:36.645491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 284/549] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:36 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:36.645618 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-a132db5c-d9fe-4b28-88cf-e8a8c99e420e req-619864fe-c6b9-454a-8007-8acdcef6d7cf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87090e23-8967-41e3-93f5-2c475fe348cf", "name": "network-vif-plugged", "status": "completed", "tag": "f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:36.653690 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-a132db5c-d9fe-4b28-88cf-e8a8c99e420e req-619864fe-c6b9-454a-8007-8acdcef6d7cf service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:36.654128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-a132db5c-d9fe-4b28-88cf-e8a8c99e420e req-619864fe-c6b9-454a-8007-8acdcef6d7cf service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:36.666400 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-a132db5c-d9fe-4b28-88cf-e8a8c99e420e req-619864fe-c6b9-454a-8007-8acdcef6d7cf service nova] Creating event network-vif-plugged:f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb for instance 87090e23-8967-41e3-93f5-2c475fe348cf on hv-cinder-75510 Jun 06 13:12:36.671175 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-a132db5c-d9fe-4b28-88cf-e8a8c99e420e req-619864fe-c6b9-454a-8007-8acdcef6d7cf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029137 Jun 06 13:12:36.671798 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 266/550] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:12:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:37.122846 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-957b9c78-24ac-44ef-b8b7-854d4b108e6b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:37.123656 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-957b9c78-24ac-44ef-b8b7-854d4b108e6b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:37.129846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ea8dcd49-78fc-4d40-817f-f564454cb154 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:37.131269 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ea8dcd49-78fc-4d40-817f-f564454cb154 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:37.134105 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-957b9c78-24ac-44ef-b8b7-854d4b108e6b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:37.135314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-957b9c78-24ac-44ef-b8b7-854d4b108e6b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:37.136367 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-957b9c78-24ac-44ef-b8b7-854d4b108e6b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:37.137056 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-957b9c78-24ac-44ef-b8b7-854d4b108e6b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:37.141168 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ea8dcd49-78fc-4d40-817f-f564454cb154 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:37.141841 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ea8dcd49-78fc-4d40-817f-f564454cb154 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:37.142927 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ea8dcd49-78fc-4d40-817f-f564454cb154 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:37.143441 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ea8dcd49-78fc-4d40-817f-f564454cb154 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:37.349737 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-957b9c78-24ac-44ef-b8b7-854d4b108e6b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:37.352996 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ea8dcd49-78fc-4d40-817f-f564454cb154 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:37.358388 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-957b9c78-24ac-44ef-b8b7-854d4b108e6b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1683 microversion: 2.1 time: 0.240233 Jun 06 13:12:37.360735 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 285/551] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:37 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1683 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:37.363304 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ea8dcd49-78fc-4d40-817f-f564454cb154 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1318 microversion: 2.1 time: 0.238642 Jun 06 13:12:37.364119 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 267/552] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:37 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1318 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:37.376044 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8392a0ab-2af9-4a76-ade9-26c23c71d040 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:37.376453 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8392a0ab-2af9-4a76-ade9-26c23c71d040 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:37.382677 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8392a0ab-2af9-4a76-ade9-26c23c71d040 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:37.383117 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8392a0ab-2af9-4a76-ade9-26c23c71d040 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:37.383893 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8392a0ab-2af9-4a76-ade9-26c23c71d040 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:37.384319 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8392a0ab-2af9-4a76-ade9-26c23c71d040 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:37.513860 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8392a0ab-2af9-4a76-ade9-26c23c71d040 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:37.521866 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8392a0ab-2af9-4a76-ade9-26c23c71d040 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.150286 Jun 06 13:12:37.522526 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 286/553] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:37 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:37.658532 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5afc5ea2-0bab-4340-adb2-200ad16cff4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:37.659137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5afc5ea2-0bab-4340-adb2-200ad16cff4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:37.661796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-13e547d2-f0fa-487a-8dc1-d1b1a4715118 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:37.662398 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-13e547d2-f0fa-487a-8dc1-d1b1a4715118 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:37.665382 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5afc5ea2-0bab-4340-adb2-200ad16cff4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:37.665821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5afc5ea2-0bab-4340-adb2-200ad16cff4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:37.666573 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5afc5ea2-0bab-4340-adb2-200ad16cff4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:37.666998 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5afc5ea2-0bab-4340-adb2-200ad16cff4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:37.668469 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-13e547d2-f0fa-487a-8dc1-d1b1a4715118 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:37.668913 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-13e547d2-f0fa-487a-8dc1-d1b1a4715118 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:37.669663 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-13e547d2-f0fa-487a-8dc1-d1b1a4715118 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:37.670092 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-13e547d2-f0fa-487a-8dc1-d1b1a4715118 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:37.869334 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-13e547d2-f0fa-487a-8dc1-d1b1a4715118 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:37.878288 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-13e547d2-f0fa-487a-8dc1-d1b1a4715118 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.220545 Jun 06 13:12:37.878753 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5afc5ea2-0bab-4340-adb2-200ad16cff4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:37.878991 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 287/554] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:37 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:37.886549 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5afc5ea2-0bab-4340-adb2-200ad16cff4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1679 microversion: 2.1 time: 0.232754 Jun 06 13:12:37.887717 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 268/555] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:37 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1679 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:38.237036 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-4021cf5d-a5ff-43e3-9b7c-c62045d81487 req-c22cb4bf-c13d-439b-88b4-71cc8ae94f03 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ec960d68-c9a5-4886-a3f3-07c63abf3cce", "name": "network-vif-deleted", "tag": "cbf0dd9f-4c61-43db-b99d-07520fba79b9"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:38.245477 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-4021cf5d-a5ff-43e3-9b7c-c62045d81487 req-c22cb4bf-c13d-439b-88b4-71cc8ae94f03 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:38.245916 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-4021cf5d-a5ff-43e3-9b7c-c62045d81487 req-c22cb4bf-c13d-439b-88b4-71cc8ae94f03 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:38.257135 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-4021cf5d-a5ff-43e3-9b7c-c62045d81487 req-c22cb4bf-c13d-439b-88b4-71cc8ae94f03 service nova] Creating event network-vif-deleted:cbf0dd9f-4c61-43db-b99d-07520fba79b9 for instance ec960d68-c9a5-4886-a3f3-07c63abf3cce on hv-cinder-75510 Jun 06 13:12:38.261943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-4021cf5d-a5ff-43e3-9b7c-c62045d81487 req-c22cb4bf-c13d-439b-88b4-71cc8ae94f03 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028550 Jun 06 13:12:38.262523 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 288/556] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:12:38 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:38.383363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5c780521-8af8-4ccc-8722-17c7e31c0033 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:38.385676 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2fbb6e6e-5ca2-445a-8506-da6b78902d41 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:38.386414 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2fbb6e6e-5ca2-445a-8506-da6b78902d41 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:38.388650 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5c780521-8af8-4ccc-8722-17c7e31c0033 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:38.399304 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c780521-8af8-4ccc-8722-17c7e31c0033 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:38.399790 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c780521-8af8-4ccc-8722-17c7e31c0033 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:38.400568 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c780521-8af8-4ccc-8722-17c7e31c0033 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:38.401003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c780521-8af8-4ccc-8722-17c7e31c0033 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:38.408086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2fbb6e6e-5ca2-445a-8506-da6b78902d41 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:38.408546 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2fbb6e6e-5ca2-445a-8506-da6b78902d41 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:38.409329 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2fbb6e6e-5ca2-445a-8506-da6b78902d41 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:38.409948 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2fbb6e6e-5ca2-445a-8506-da6b78902d41 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:38.507180 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5c780521-8af8-4ccc-8722-17c7e31c0033 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:38.516185 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5c780521-8af8-4ccc-8722-17c7e31c0033 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1616 microversion: 2.1 time: 0.141928 Jun 06 13:12:38.517400 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 269/557] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:38 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1616 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:38.538381 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-8e519fe8-183c-4bec-a7c9-44f58dda26fd tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:38.538986 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8e519fe8-183c-4bec-a7c9-44f58dda26fd tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:38.544983 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8e519fe8-183c-4bec-a7c9-44f58dda26fd tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:38.545429 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8e519fe8-183c-4bec-a7c9-44f58dda26fd tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:38.546247 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8e519fe8-183c-4bec-a7c9-44f58dda26fd tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:38.546736 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8e519fe8-183c-4bec-a7c9-44f58dda26fd tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:38.586016 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2fbb6e6e-5ca2-445a-8506-da6b78902d41 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:38.594836 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2fbb6e6e-5ca2-445a-8506-da6b78902d41 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1318 microversion: 2.1 time: 0.217271 Jun 06 13:12:38.599883 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 289/558] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:38 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1318 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:38.699490 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-8e519fe8-183c-4bec-a7c9-44f58dda26fd tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:38.708267 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-8e519fe8-183c-4bec-a7c9-44f58dda26fd tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1356 microversion: 2.1 time: 0.173470 Jun 06 13:12:38.709204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 270/559] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:38 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1356 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:38.913169 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-528eebcf-2af9-436d-84f4-b05d65cf4e5e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:38.917500 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-528eebcf-2af9-436d-84f4-b05d65cf4e5e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:38.928406 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a5f9a161-9ed6-4a82-817f-d2dfa8c58fcb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:38.933327 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a5f9a161-9ed6-4a82-817f-d2dfa8c58fcb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:38.934374 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-528eebcf-2af9-436d-84f4-b05d65cf4e5e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:38.934828 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-528eebcf-2af9-436d-84f4-b05d65cf4e5e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:38.935644 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-528eebcf-2af9-436d-84f4-b05d65cf4e5e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:38.936084 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-528eebcf-2af9-436d-84f4-b05d65cf4e5e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:38.951675 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5f9a161-9ed6-4a82-817f-d2dfa8c58fcb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:38.952609 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5f9a161-9ed6-4a82-817f-d2dfa8c58fcb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:38.955781 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5f9a161-9ed6-4a82-817f-d2dfa8c58fcb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:38.956747 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5f9a161-9ed6-4a82-817f-d2dfa8c58fcb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:39.189783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-528eebcf-2af9-436d-84f4-b05d65cf4e5e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:39.193362 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a5f9a161-9ed6-4a82-817f-d2dfa8c58fcb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:39.198196 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-528eebcf-2af9-436d-84f4-b05d65cf4e5e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1679 microversion: 2.1 time: 0.297401 Jun 06 13:12:39.199103 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 290/560] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:38 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1679 bytes in 299 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:39.202037 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a5f9a161-9ed6-4a82-817f-d2dfa8c58fcb tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.278305 Jun 06 13:12:39.202871 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 271/561] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:38 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:39.533886 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7a74ae35-9475-437d-b536-43755c6157d9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:39.534553 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7a74ae35-9475-437d-b536-43755c6157d9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:39.540926 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a74ae35-9475-437d-b536-43755c6157d9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:39.541368 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a74ae35-9475-437d-b536-43755c6157d9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:39.542119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a74ae35-9475-437d-b536-43755c6157d9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:39.542577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a74ae35-9475-437d-b536-43755c6157d9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:39.575515 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a74ae35-9475-437d-b536-43755c6157d9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:39.576134 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7a74ae35-9475-437d-b536-43755c6157d9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:39.576576 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-7a74ae35-9475-437d-b536-43755c6157d9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lazy-loading 'fault' on Instance uuid ec960d68-c9a5-4886-a3f3-07c63abf3cce {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:12:39.613272 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-49ad608f-0a2f-4ef8-a6e7-c0c0d56e6885 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:39.613836 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-49ad608f-0a2f-4ef8-a6e7-c0c0d56e6885 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:39.618717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7a74ae35-9475-437d-b536-43755c6157d9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:39.620460 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-49ad608f-0a2f-4ef8-a6e7-c0c0d56e6885 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:39.620908 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-49ad608f-0a2f-4ef8-a6e7-c0c0d56e6885 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:39.621683 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-49ad608f-0a2f-4ef8-a6e7-c0c0d56e6885 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:39.622135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-49ad608f-0a2f-4ef8-a6e7-c0c0d56e6885 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:39.627208 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7a74ae35-9475-437d-b536-43755c6157d9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 200 len: 1332 microversion: 2.1 time: 0.097474 Jun 06 13:12:39.627810 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 291/562] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:39 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 1332 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:39.724696 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0925df09-7ed4-451c-b407-4890f6e40278 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:39.725330 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0925df09-7ed4-451c-b407-4890f6e40278 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:39.731338 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0925df09-7ed4-451c-b407-4890f6e40278 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:39.731818 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0925df09-7ed4-451c-b407-4890f6e40278 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:39.732581 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0925df09-7ed4-451c-b407-4890f6e40278 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:39.733029 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0925df09-7ed4-451c-b407-4890f6e40278 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:39.756164 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-49ad608f-0a2f-4ef8-a6e7-c0c0d56e6885 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:39.763544 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-49ad608f-0a2f-4ef8-a6e7-c0c0d56e6885 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1318 microversion: 2.1 time: 0.155895 Jun 06 13:12:39.765106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 272/563] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:39 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1318 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:39.865756 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0925df09-7ed4-451c-b407-4890f6e40278 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:39.873121 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0925df09-7ed4-451c-b407-4890f6e40278 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1545 microversion: 2.1 time: 0.152401 Jun 06 13:12:39.873674 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 292/564] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:39 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1545 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:39.891250 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-38819d60-9212-464c-85ce-f1f0a7389900 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:39.891987 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-38819d60-9212-464c-85ce-f1f0a7389900 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:39.898014 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38819d60-9212-464c-85ce-f1f0a7389900 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:39.898460 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38819d60-9212-464c-85ce-f1f0a7389900 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:39.899211 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38819d60-9212-464c-85ce-f1f0a7389900 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:39.899696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38819d60-9212-464c-85ce-f1f0a7389900 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.028718 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-38819d60-9212-464c-85ce-f1f0a7389900 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:40.037725 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-38819d60-9212-464c-85ce-f1f0a7389900 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1545 microversion: 2.1 time: 0.150287 Jun 06 13:12:40.038305 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 273/565] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:39 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1545 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:40.053835 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c42a25a5-2fb5-4e49-a258-25e5a545b18d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:40.057289 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c42a25a5-2fb5-4e49-a258-25e5a545b18d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:40.058040 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c42a25a5-2fb5-4e49-a258-25e5a545b18d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Searching by: {'deleted': False, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5'} {{(pid=118133) get_all /opt/stack/nova/nova/compute/api.py:2962}} Jun 06 13:12:40.065010 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c42a25a5-2fb5-4e49-a258-25e5a545b18d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:40.065454 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c42a25a5-2fb5-4e49-a258-25e5a545b18d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.066249 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c42a25a5-2fb5-4e49-a258-25e5a545b18d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:40.066681 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c42a25a5-2fb5-4e49-a258-25e5a545b18d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.156884 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.multi_cell_list [None req-c42a25a5-2fb5-4e49-a258-25e5a545b18d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=118133) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Jun 06 13:12:40.215048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9defeea8-01ff-496d-95e0-a98e15876fb4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:40.215732 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9defeea8-01ff-496d-95e0-a98e15876fb4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:40.222390 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9defeea8-01ff-496d-95e0-a98e15876fb4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:40.222858 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9defeea8-01ff-496d-95e0-a98e15876fb4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.223640 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9defeea8-01ff-496d-95e0-a98e15876fb4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:40.224067 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9defeea8-01ff-496d-95e0-a98e15876fb4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.253907 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c42a25a5-2fb5-4e49-a258-25e5a545b18d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers" status: 200 len: 341 microversion: 2.1 time: 0.203722 Jun 06 13:12:40.254488 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 293/566] 10.222.0.13 () {58 vars in 1124 bytes} [Mon Jun 6 13:12:40 2022] GET /compute/v2.1/servers => generated 341 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:40.260088 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6fe55f4b-aff2-4c14-8014-ec1e8888abee tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:40.260681 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6fe55f4b-aff2-4c14-8014-ec1e8888abee tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:40.269600 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6fe55f4b-aff2-4c14-8014-ec1e8888abee tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:40.270064 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6fe55f4b-aff2-4c14-8014-ec1e8888abee tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.270829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6fe55f4b-aff2-4c14-8014-ec1e8888abee tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:40.271257 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6fe55f4b-aff2-4c14-8014-ec1e8888abee tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.405077 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9defeea8-01ff-496d-95e0-a98e15876fb4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:40.414005 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9defeea8-01ff-496d-95e0-a98e15876fb4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1679 microversion: 2.1 time: 0.202754 Jun 06 13:12:40.414509 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 274/567] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:40 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1679 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:40.418843 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e737f076-c936-4a3b-ab80-29cce20cf421 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:40.420655 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e737f076-c936-4a3b-ab80-29cce20cf421 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:40.429197 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e737f076-c936-4a3b-ab80-29cce20cf421 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:40.429641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e737f076-c936-4a3b-ab80-29cce20cf421 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.430407 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e737f076-c936-4a3b-ab80-29cce20cf421 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:40.430837 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e737f076-c936-4a3b-ab80-29cce20cf421 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.444448 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6fe55f4b-aff2-4c14-8014-ec1e8888abee tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:40.454254 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6fe55f4b-aff2-4c14-8014-ec1e8888abee tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.197723 Jun 06 13:12:40.454940 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 294/568] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:40 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:40.568931 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-b5c7081e-1591-4529-b4ea-deb1e11833c0 req-298bc0c3-f0ba-480b-856c-07baf2618231 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80076dd-2d71-451c-b869-d14a0f507ac7", "name": "network-vif-plugged", "status": "completed", "tag": "22c6e2ec-7fcf-457c-991b-931ea9ea289f"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:40.576461 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e737f076-c936-4a3b-ab80-29cce20cf421 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:40.578550 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-b5c7081e-1591-4529-b4ea-deb1e11833c0 req-298bc0c3-f0ba-480b-856c-07baf2618231 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:40.579058 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-b5c7081e-1591-4529-b4ea-deb1e11833c0 req-298bc0c3-f0ba-480b-856c-07baf2618231 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.584831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e737f076-c936-4a3b-ab80-29cce20cf421 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1545 microversion: 2.1 time: 0.169351 Jun 06 13:12:40.585626 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 275/569] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:40 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1545 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:40.590381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-b5c7081e-1591-4529-b4ea-deb1e11833c0 req-298bc0c3-f0ba-480b-856c-07baf2618231 service nova] Creating event network-vif-plugged:22c6e2ec-7fcf-457c-991b-931ea9ea289f for instance c80076dd-2d71-451c-b869-d14a0f507ac7 on hv-cinder-75510 Jun 06 13:12:40.600622 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-b5c7081e-1591-4529-b4ea-deb1e11833c0 req-298bc0c3-f0ba-480b-856c-07baf2618231 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034398 Jun 06 13:12:40.600622 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 295/570] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:12:40 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:12:40.644482 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6b5db82a-578a-4794-9cef-1c8e588922cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:40.646424 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6b5db82a-578a-4794-9cef-1c8e588922cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:40.653638 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6b5db82a-578a-4794-9cef-1c8e588922cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:40.654461 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6b5db82a-578a-4794-9cef-1c8e588922cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.655248 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6b5db82a-578a-4794-9cef-1c8e588922cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:40.656253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6b5db82a-578a-4794-9cef-1c8e588922cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.674929 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-6b5db82a-578a-4794-9cef-1c8e588922cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6b5db82a-578a-4794-9cef-1c8e588922cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce HTTP/1.1 Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:12:40.675921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:12:40.677524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:12:40.677524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:12:40.677524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:12:40.677524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:12:40.677524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:12:40.677524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:12:40.677524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:12:40.677524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:12:40.677524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:12:40.677524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:12:40.677524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:12:40.677524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': 'ec960d68-c9a5-4886-a3f3-07c63abf3cce'} Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:12:40.678378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:12:40.679658 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:40.681303 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6b5db82a-578a-4794-9cef-1c8e588922cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 404 to user: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:12:40.681303 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6b5db82a-578a-4794-9cef-1c8e588922cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 404 len: 111 microversion: 2.1 time: 0.037201 Jun 06 13:12:40.681303 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 276/571] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:40 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 111 bytes in 38 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:12:40.686670 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2e76f127-53f3-4975-b612-d7b67aedd61e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '.version_select at 0x7f0efc112c10>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:40.758606 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2e76f127-53f3-4975-b612-d7b67aedd61e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1731660967" status: 202 len: 0 microversion: 2.1 time: 0.076044 Jun 06 13:12:40.759214 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 296/572] 10.222.0.13 () {58 vars in 1220 bytes} [Mon Jun 6 13:12:40 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1731660967 => generated 0 bytes in 77 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:12:40.781853 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-37074495-1035-42b5-ae66-1f6d065ab351 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:40.782460 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-37074495-1035-42b5-ae66-1f6d065ab351 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:40.788832 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-37074495-1035-42b5-ae66-1f6d065ab351 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:40.796027 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-37074495-1035-42b5-ae66-1f6d065ab351 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.796027 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-37074495-1035-42b5-ae66-1f6d065ab351 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:40.796027 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-37074495-1035-42b5-ae66-1f6d065ab351 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:40.933266 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-37074495-1035-42b5-ae66-1f6d065ab351 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:40.943756 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-37074495-1035-42b5-ae66-1f6d065ab351 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1318 microversion: 2.1 time: 0.166241 Jun 06 13:12:40.944438 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 277/573] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:40 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1318 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:41.432101 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2bec6734-4e70-4e2a-b6f7-690f0cb03ebe tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:41.433013 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2bec6734-4e70-4e2a-b6f7-690f0cb03ebe tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:41.439859 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2bec6734-4e70-4e2a-b6f7-690f0cb03ebe tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:41.440428 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2bec6734-4e70-4e2a-b6f7-690f0cb03ebe tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:41.441138 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2bec6734-4e70-4e2a-b6f7-690f0cb03ebe tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:41.441573 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2bec6734-4e70-4e2a-b6f7-690f0cb03ebe tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:41.471836 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-8a81addf-ee6c-47f1-9b0c-be488e0ffe41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:41.476752 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8a81addf-ee6c-47f1-9b0c-be488e0ffe41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:41.478555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8a81addf-ee6c-47f1-9b0c-be488e0ffe41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:41.479003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8a81addf-ee6c-47f1-9b0c-be488e0ffe41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:41.479859 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8a81addf-ee6c-47f1-9b0c-be488e0ffe41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:41.480298 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8a81addf-ee6c-47f1-9b0c-be488e0ffe41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:41.714513 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2bec6734-4e70-4e2a-b6f7-690f0cb03ebe tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:41.723132 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2bec6734-4e70-4e2a-b6f7-690f0cb03ebe tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1679 microversion: 2.1 time: 0.295239 Jun 06 13:12:41.723941 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 297/574] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:41 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1679 bytes in 297 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:41.740033 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-8a81addf-ee6c-47f1-9b0c-be488e0ffe41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:41.748564 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-8a81addf-ee6c-47f1-9b0c-be488e0ffe41 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.280900 Jun 06 13:12:41.749390 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 278/575] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:41 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:41.765878 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3ffa756b-e547-4b75-b09e-6616ce34a009 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Action: 'create', calling method: .version_select at 0x7f0efc0fd0d0>, body: {"keypair": {"name": "tempest-keypair-300745952", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFoVuZB9MSMnf50ZISxZV8o87KrF+6oqbr6Rn3uwNoSqp2USSx44xIRrZVNnb8ceYhLMLmnXdh0c2y+0CabvYU/Z86dHGr+ckAz6qlm6kJJgKE0L+IvFAs/PPzs11REw1w=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:41.779443 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-3ffa756b-e547-4b75-b09e-6616ce34a009 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for project d6db503a0a1749789e92ed63f5a113b7. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:12:41.783591 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-3ffa756b-e547-4b75-b09e-6616ce34a009 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for user 9c620175b84d4cee9aef398864c03c8d and project d6db503a0a1749789e92ed63f5a113b7. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:12:41.889610 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3ffa756b-e547-4b75-b09e-6616ce34a009 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.127512 Jun 06 13:12:41.890257 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 298/576] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 13:12:41 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:41.962346 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c85a0b29-6e47-4cb9-b317-f16cded01bd0 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:41.962896 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c85a0b29-6e47-4cb9-b317-f16cded01bd0 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:41.969742 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c85a0b29-6e47-4cb9-b317-f16cded01bd0 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:41.970182 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c85a0b29-6e47-4cb9-b317-f16cded01bd0 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:41.970994 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c85a0b29-6e47-4cb9-b317-f16cded01bd0 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:41.971420 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c85a0b29-6e47-4cb9-b317-f16cded01bd0 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:42.147259 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c85a0b29-6e47-4cb9-b317-f16cded01bd0 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:42.154683 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c85a0b29-6e47-4cb9-b317-f16cded01bd0 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1318 microversion: 2.1 time: 0.196393 Jun 06 13:12:42.155310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 279/577] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:41 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1318 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:42.497885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2a9ce6b6-f7c6-41d1-8fa4-06964cc00b56 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "fe09353a-b690-41be-a143-69be08531a6b"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:42.498945 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2a9ce6b6-f7c6-41d1-8fa4-06964cc00b56 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:42.505771 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2a9ce6b6-f7c6-41d1-8fa4-06964cc00b56 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:42.509711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2a9ce6b6-f7c6-41d1-8fa4-06964cc00b56 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:42.509711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2a9ce6b6-f7c6-41d1-8fa4-06964cc00b56 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:42.509711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2a9ce6b6-f7c6-41d1-8fa4-06964cc00b56 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:42.741014 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9771284f-a6ba-47c6-a27b-86f29252a78b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:42.741550 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9771284f-a6ba-47c6-a27b-86f29252a78b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:42.748045 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9771284f-a6ba-47c6-a27b-86f29252a78b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:42.748504 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9771284f-a6ba-47c6-a27b-86f29252a78b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:42.749251 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9771284f-a6ba-47c6-a27b-86f29252a78b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:42.750359 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9771284f-a6ba-47c6-a27b-86f29252a78b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:42.898237 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9771284f-a6ba-47c6-a27b-86f29252a78b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:42.905756 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9771284f-a6ba-47c6-a27b-86f29252a78b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1679 microversion: 2.1 time: 0.168676 Jun 06 13:12:42.907042 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 280/578] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:42 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1679 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:42.912371 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-24acdec4-e8b2-4337-a687-814243b76087 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:42.912968 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-24acdec4-e8b2-4337-a687-814243b76087 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:42.919578 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-24acdec4-e8b2-4337-a687-814243b76087 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:42.920398 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-24acdec4-e8b2-4337-a687-814243b76087 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:42.920775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-24acdec4-e8b2-4337-a687-814243b76087 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:42.921207 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-24acdec4-e8b2-4337-a687-814243b76087 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:43.072821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-24acdec4-e8b2-4337-a687-814243b76087 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:43.075107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=100 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:43.081990 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-24acdec4-e8b2-4337-a687-814243b76087 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.173842 Jun 06 13:12:43.082577 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 281/579] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:42 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:43.172784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6a1a950a-c541-40ff-9c70-a215140cc80c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:43.173253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6a1a950a-c541-40ff-9c70-a215140cc80c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:43.179418 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6a1a950a-c541-40ff-9c70-a215140cc80c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:43.179944 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6a1a950a-c541-40ff-9c70-a215140cc80c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:43.183867 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6a1a950a-c541-40ff-9c70-a215140cc80c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:43.183867 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6a1a950a-c541-40ff-9c70-a215140cc80c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:43.330619 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6a1a950a-c541-40ff-9c70-a215140cc80c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:43.338267 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6a1a950a-c541-40ff-9c70-a215140cc80c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1508 microversion: 2.1 time: 0.170429 Jun 06 13:12:43.338829 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 282/580] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:43 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1508 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:43.355073 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3d26ac98-cf00-472b-8491-d45969a6422b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1757d5f9-0918-4599-b6e1-5e5da7a0f32e", "device": "/dev/sdb"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:43.358866 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3d26ac98-cf00-472b-8491-d45969a6422b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:43.362496 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d26ac98-cf00-472b-8491-d45969a6422b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:43.362942 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d26ac98-cf00-472b-8491-d45969a6422b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:43.363735 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d26ac98-cf00-472b-8491-d45969a6422b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:43.364165 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d26ac98-cf00-472b-8491-d45969a6422b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:44.099791 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2a9ce6b6-f7c6-41d1-8fa4-06964cc00b56 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "POST /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.605596 Jun 06 13:12:44.100382 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 299/581] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:12:42 2022] POST /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/os-volume_attachments => generated 194 bytes in 1607 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:44.105446 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9b92805a-e85f-4ced-8d57-bc2593c673d7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:44.106173 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9b92805a-e85f-4ced-8d57-bc2593c673d7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:44.113207 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9b92805a-e85f-4ced-8d57-bc2593c673d7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:44.113717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9b92805a-e85f-4ced-8d57-bc2593c673d7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:44.114548 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9b92805a-e85f-4ced-8d57-bc2593c673d7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:44.115120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9b92805a-e85f-4ced-8d57-bc2593c673d7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:44.268824 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9b92805a-e85f-4ced-8d57-bc2593c673d7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:44.276335 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9b92805a-e85f-4ced-8d57-bc2593c673d7 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1656 microversion: 2.1 time: 0.174824 Jun 06 13:12:44.276892 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 300/582] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:44 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1656 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:44.281982 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ca19f970-0d78-42a9-af76-8af86db4a209 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:44.282652 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ca19f970-0d78-42a9-af76-8af86db4a209 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:44.288932 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca19f970-0d78-42a9-af76-8af86db4a209 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:44.289360 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca19f970-0d78-42a9-af76-8af86db4a209 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:44.290110 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca19f970-0d78-42a9-af76-8af86db4a209 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:44.290554 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca19f970-0d78-42a9-af76-8af86db4a209 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:44.356151 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3d26ac98-cf00-472b-8491-d45969a6422b tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "POST /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.004680 Jun 06 13:12:44.357626 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 283/583] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:12:43 2022] POST /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7/os-volume_attachments => generated 194 bytes in 1007 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:12:44.368514 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1207759914", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e6b38e7-6e44-43bf-a66b-a75358de1034"}], "security_groups": [{"name": "tempest-securitygroup--51266276"}], "key_name": "tempest-keypair-300745952", "user_data": "}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:44.438283 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ca19f970-0d78-42a9-af76-8af86db4a209 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:44.446549 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ca19f970-0d78-42a9-af76-8af86db4a209 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.168667 Jun 06 13:12:44.447120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 301/584] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:44 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:44.451606 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6997bd1b-ee7c-494f-aa6d-2cf0028fe933 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:44.458560 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6997bd1b-ee7c-494f-aa6d-2cf0028fe933 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:44.459280 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6997bd1b-ee7c-494f-aa6d-2cf0028fe933 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:44.482018 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6997bd1b-ee7c-494f-aa6d-2cf0028fe933 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Going to try to start instance {{(pid=118133) start /opt/stack/nova/nova/compute/api.py:2730}} Jun 06 13:12:44.486128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.network.neutron [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] validate_networks() for [('2e6b38e7-6e44-43bf-a66b-a75358de1034', None, None, None, None, None)] {{(pid=118134) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:12:44.486797 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:44.698127 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6997bd1b-ee7c-494f-aa6d-2cf0028fe933 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "POST /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/action" status: 202 len: 0 microversion: 2.1 time: 0.249709 Jun 06 13:12:44.698735 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 302/585] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:12:44 2022] POST /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/action => generated 0 bytes in 251 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:12:44.708238 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bea5205e-26d9-4681-b83a-b294b9f0c822 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:44.708938 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bea5205e-26d9-4681-b83a-b294b9f0c822 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:44.715503 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bea5205e-26d9-4681-b83a-b294b9f0c822 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:44.716011 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bea5205e-26d9-4681-b83a-b294b9f0c822 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:44.716792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bea5205e-26d9-4681-b83a-b294b9f0c822 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:44.717228 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bea5205e-26d9-4681-b83a-b294b9f0c822 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:44.947092 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bea5205e-26d9-4681-b83a-b294b9f0c822 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:44.954923 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bea5205e-26d9-4681-b83a-b294b9f0c822 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1665 microversion: 2.1 time: 0.251837 Jun 06 13:12:44.955505 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 303/586] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:44 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1665 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:45.152834 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Flavor limits 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:12:45.153324 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Image limits 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:12:45.153799 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Flavor pref 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:12:45.154235 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Image pref 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:12:45.154831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:12:45.164561 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:45.165008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:45.165802 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:45.166261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:45.184633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for project d6db503a0a1749789e92ed63f5a113b7. Resources: {'cores', 'ram', 'instances'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:12:45.189007 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for user 9c620175b84d4cee9aef398864c03c8d and project d6db503a0a1749789e92ed63f5a113b7. Resources: {'cores', 'ram', 'instances'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:12:45.200509 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Going to run 1 instances... {{(pid=118134) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:12:45.202964 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:12:45.214664 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=99,nova_api:UPDATE=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:45.304588 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-849f83b8-9738-4d0d-a2bb-839d27c04165 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 0.945748 Jun 06 13:12:45.310829 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 284/587] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:12:44 2022] POST /compute/v2.1/servers => generated 400 bytes in 952 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:12:45.316210 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0b354a48-1a0c-4861-9450-aec989245a2f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:45.316960 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0b354a48-1a0c-4861-9450-aec989245a2f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:45.323885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=98,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:45.373389 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0b354a48-1a0c-4861-9450-aec989245a2f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:45.383263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0b354a48-1a0c-4861-9450-aec989245a2f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1241 microversion: 2.1 time: 0.068766 Jun 06 13:12:45.383263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 304/588] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:45 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1241 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:45.464393 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2da67c4f-6c04-418d-95da-a224d32ee121 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:45.465196 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2da67c4f-6c04-418d-95da-a224d32ee121 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:45.474960 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2da67c4f-6c04-418d-95da-a224d32ee121 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:45.474960 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2da67c4f-6c04-418d-95da-a224d32ee121 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:45.475781 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2da67c4f-6c04-418d-95da-a224d32ee121 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:45.476330 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2da67c4f-6c04-418d-95da-a224d32ee121 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:45.614322 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-2da67c4f-6c04-418d-95da-a224d32ee121 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:45.622294 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2da67c4f-6c04-418d-95da-a224d32ee121 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1735 microversion: 2.1 time: 0.161792 Jun 06 13:12:45.623288 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 285/589] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:45 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1735 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:45.972205 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0be2a52b-8d42-4844-87e2-f81cdb6b82dd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:45.972844 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0be2a52b-8d42-4844-87e2-f81cdb6b82dd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:45.980225 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0be2a52b-8d42-4844-87e2-f81cdb6b82dd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:45.980676 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0be2a52b-8d42-4844-87e2-f81cdb6b82dd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:45.981446 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0be2a52b-8d42-4844-87e2-f81cdb6b82dd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:45.981883 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0be2a52b-8d42-4844-87e2-f81cdb6b82dd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:46.121727 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0be2a52b-8d42-4844-87e2-f81cdb6b82dd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:46.130236 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0be2a52b-8d42-4844-87e2-f81cdb6b82dd tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1665 microversion: 2.1 time: 0.162338 Jun 06 13:12:46.130815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 305/590] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:45 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1665 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:46.398074 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-473af704-21a9-45d1-894f-302b0f52ed3c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:46.398787 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-473af704-21a9-45d1-894f-302b0f52ed3c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:46.405392 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-473af704-21a9-45d1-894f-302b0f52ed3c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:46.405837 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-473af704-21a9-45d1-894f-302b0f52ed3c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:46.406962 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-473af704-21a9-45d1-894f-302b0f52ed3c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:46.407400 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-473af704-21a9-45d1-894f-302b0f52ed3c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:46.469467 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-473af704-21a9-45d1-894f-302b0f52ed3c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:46.477006 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-473af704-21a9-45d1-894f-302b0f52ed3c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1245 microversion: 2.1 time: 0.082877 Jun 06 13:12:46.477567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 286/591] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:46 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1245 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:46.640527 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-eb919757-6426-4090-a7ce-b33ed05393d8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:46.641484 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-eb919757-6426-4090-a7ce-b33ed05393d8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:46.647424 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eb919757-6426-4090-a7ce-b33ed05393d8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:46.647901 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eb919757-6426-4090-a7ce-b33ed05393d8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:46.648667 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eb919757-6426-4090-a7ce-b33ed05393d8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:46.649107 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eb919757-6426-4090-a7ce-b33ed05393d8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:46.776479 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-eb919757-6426-4090-a7ce-b33ed05393d8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:46.785593 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-eb919757-6426-4090-a7ce-b33ed05393d8 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1715 microversion: 2.1 time: 0.149299 Jun 06 13:12:46.786172 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 306/592] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:46 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1715 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:46.886279 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fae3303a-1b26-406b-8a80-660eca7f1099 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:46.886764 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-fae3303a-1b26-406b-8a80-660eca7f1099 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:46.892878 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fae3303a-1b26-406b-8a80-660eca7f1099 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:46.893315 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fae3303a-1b26-406b-8a80-660eca7f1099 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:46.894058 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fae3303a-1b26-406b-8a80-660eca7f1099 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:46.894481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fae3303a-1b26-406b-8a80-660eca7f1099 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:46.977450 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-fae3303a-1b26-406b-8a80-660eca7f1099 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] HTTP exception thrown: Cannot 'detach_volume' instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed while it is in vm_state rescued Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fae3303a-1b26-406b-8a80-660eca7f1099 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Request method failure captured: Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: DELETE /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-volume_attachments/d20211b5-66ff-4f7d-855d-18cabdcbc58e HTTP/1.1 Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxZJTqH2tvjPaOfLf-GjKi9DdpfIw9vV-Dj8yIkT7Rz3rbj4seroxoGaC5amp93DC0XDdTji9E52xtlJmjDKJNS6ZcOTzI7g0ybI49K_1pbrztUd9_A_fsQh8uT7czdbHN5L1S_Ro5cLnbwPwf9s-JIk1_jyoTpeaVfStvrpu_2Lhk Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: d2263cfc378b4967ab4d2817991874f5 Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:12:46.979161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:12:46.980775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d2263cfc378b4967ab4d2817991874f5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d2263cfc378b4967ab4d2817991874f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d2263cfc378b4967ab4d2817991874f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d2263cfc378b4967ab4d2817991874f5"}]}] Jun 06 13:12:46.980775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:12:46.980775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: d2263cfc378b4967ab4d2817991874f5 Jun 06 13:12:46.980775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:12:46.980775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-ServerRescueNegativeTestJSON-1216849386-project Jun 06 13:12:46.980775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:12:46.980775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:12:46.980775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: e8410e3632ec4908824d336fff667da5 Jun 06 13:12:46.980775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1216849386-project Jun 06 13:12:46.980775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:12:46.980775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Cannot 'detach_volume' instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed while it is in vm_state rescued Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'server_id': 'a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed', 'id': 'd20211b5-66ff-4f7d-855d-18cabdcbc58e'} Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 145, in inner Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed in vm_state rescued. Cannot detach_volume while the instance is in this state. Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:12:46.981610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed while it is in vm_state rescued Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed while it is in vm_state rescued Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:12:46.983078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fae3303a-1b26-406b-8a80-660eca7f1099 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Returning 409 to user: Cannot 'detach_volume' instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed while it is in vm_state rescued {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:12:46.985073 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-fae3303a-1b26-406b-8a80-660eca7f1099 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-volume_attachments/d20211b5-66ff-4f7d-855d-18cabdcbc58e" status: 409 len: 152 microversion: 2.1 time: 0.098328 Jun 06 13:12:46.985073 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 287/593] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 13:12:46 2022] DELETE /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-volume_attachments/d20211b5-66ff-4f7d-855d-18cabdcbc58e => generated 152 bytes in 99 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Jun 06 13:12:46.989893 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-57936b49-22a3-48e4-a9b5-c3290dfa9354 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:46.990424 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-57936b49-22a3-48e4-a9b5-c3290dfa9354 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:46.996893 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-57936b49-22a3-48e4-a9b5-c3290dfa9354 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:46.997342 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-57936b49-22a3-48e4-a9b5-c3290dfa9354 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:46.998100 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-57936b49-22a3-48e4-a9b5-c3290dfa9354 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:46.998535 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-57936b49-22a3-48e4-a9b5-c3290dfa9354 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:47.148007 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-71a54f2d-432b-4517-8159-d79b2124aaaf tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:47.148616 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-71a54f2d-432b-4517-8159-d79b2124aaaf tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:47.154720 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71a54f2d-432b-4517-8159-d79b2124aaaf tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:47.155193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71a54f2d-432b-4517-8159-d79b2124aaaf tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:47.155978 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71a54f2d-432b-4517-8159-d79b2124aaaf tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:47.157062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71a54f2d-432b-4517-8159-d79b2124aaaf tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:47.269526 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-57936b49-22a3-48e4-a9b5-c3290dfa9354 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "POST /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/action" status: 202 len: 0 microversion: 2.1 time: 0.283253 Jun 06 13:12:47.273657 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 307/594] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:12:46 2022] POST /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/action => generated 0 bytes in 285 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:12:47.279285 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ad6aadca-99b7-4cbc-9da6-6b1f17c16e35 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:47.280163 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ad6aadca-99b7-4cbc-9da6-6b1f17c16e35 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:47.289210 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ad6aadca-99b7-4cbc-9da6-6b1f17c16e35 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:47.289657 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ad6aadca-99b7-4cbc-9da6-6b1f17c16e35 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:47.290484 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ad6aadca-99b7-4cbc-9da6-6b1f17c16e35 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:47.290849 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ad6aadca-99b7-4cbc-9da6-6b1f17c16e35 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:47.302122 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-71a54f2d-432b-4517-8159-d79b2124aaaf tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:47.310596 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-71a54f2d-432b-4517-8159-d79b2124aaaf tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1665 microversion: 2.1 time: 0.166511 Jun 06 13:12:47.313269 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 288/595] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:47 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1665 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:47.428027 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ad6aadca-99b7-4cbc-9da6-6b1f17c16e35 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:47.437001 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ad6aadca-99b7-4cbc-9da6-6b1f17c16e35 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1723 microversion: 2.1 time: 0.161924 Jun 06 13:12:47.438390 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 308/596] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:47 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1723 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:47.494076 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-98ceb108-bb67-4729-a021-8f47c9a9ffdd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:47.494689 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-98ceb108-bb67-4729-a021-8f47c9a9ffdd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:47.502252 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-98ceb108-bb67-4729-a021-8f47c9a9ffdd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:47.502701 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-98ceb108-bb67-4729-a021-8f47c9a9ffdd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:47.503460 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-98ceb108-bb67-4729-a021-8f47c9a9ffdd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:47.503943 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-98ceb108-bb67-4729-a021-8f47c9a9ffdd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:47.565222 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-98ceb108-bb67-4729-a021-8f47c9a9ffdd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:47.572681 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-98ceb108-bb67-4729-a021-8f47c9a9ffdd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1293 microversion: 2.1 time: 0.082510 Jun 06 13:12:47.573242 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 289/597] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:47 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1293 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:48.329979 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-172b70b5-1357-4a66-812c-00d22d90a46a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:48.330633 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-172b70b5-1357-4a66-812c-00d22d90a46a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:48.337550 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-172b70b5-1357-4a66-812c-00d22d90a46a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:48.337995 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-172b70b5-1357-4a66-812c-00d22d90a46a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:48.338781 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-172b70b5-1357-4a66-812c-00d22d90a46a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:48.339213 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-172b70b5-1357-4a66-812c-00d22d90a46a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:48.455038 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-62ff8b67-6fb9-46ba-8b5a-04d938270b0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:48.456587 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-62ff8b67-6fb9-46ba-8b5a-04d938270b0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:48.462862 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-62ff8b67-6fb9-46ba-8b5a-04d938270b0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:48.463318 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-62ff8b67-6fb9-46ba-8b5a-04d938270b0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:48.464131 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-62ff8b67-6fb9-46ba-8b5a-04d938270b0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:48.464735 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-62ff8b67-6fb9-46ba-8b5a-04d938270b0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:48.504951 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-172b70b5-1357-4a66-812c-00d22d90a46a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:48.512897 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-172b70b5-1357-4a66-812c-00d22d90a46a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1669 microversion: 2.1 time: 0.186792 Jun 06 13:12:48.513693 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 309/598] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:48 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1669 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:48.590750 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-32b72e29-1ca7-438d-8cdd-f1571ea93d89 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:48.591427 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-32b72e29-1ca7-438d-8cdd-f1571ea93d89 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:48.597651 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-32b72e29-1ca7-438d-8cdd-f1571ea93d89 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:48.598243 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-32b72e29-1ca7-438d-8cdd-f1571ea93d89 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:48.599750 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-32b72e29-1ca7-438d-8cdd-f1571ea93d89 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:48.600292 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-32b72e29-1ca7-438d-8cdd-f1571ea93d89 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:48.610308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-62ff8b67-6fb9-46ba-8b5a-04d938270b0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:48.625726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-62ff8b67-6fb9-46ba-8b5a-04d938270b0f tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1723 microversion: 2.1 time: 0.173820 Jun 06 13:12:48.628081 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 290/599] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:48 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1723 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:48.680015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-32b72e29-1ca7-438d-8cdd-f1571ea93d89 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:48.688416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-32b72e29-1ca7-438d-8cdd-f1571ea93d89 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1299 microversion: 2.1 time: 0.101205 Jun 06 13:12:48.689070 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 310/600] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:48 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1299 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:49.644230 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6ee527b6-49bd-4965-83a6-07e5a1987f73 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:49.644822 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6ee527b6-49bd-4965-83a6-07e5a1987f73 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:49.651252 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6ee527b6-49bd-4965-83a6-07e5a1987f73 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:49.651723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6ee527b6-49bd-4965-83a6-07e5a1987f73 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:49.652468 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6ee527b6-49bd-4965-83a6-07e5a1987f73 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:49.652892 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6ee527b6-49bd-4965-83a6-07e5a1987f73 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:49.705900 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b034f887-6685-41a3-a3d6-580f6f0f9b1a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:49.706730 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b034f887-6685-41a3-a3d6-580f6f0f9b1a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:49.713401 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b034f887-6685-41a3-a3d6-580f6f0f9b1a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:49.713917 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b034f887-6685-41a3-a3d6-580f6f0f9b1a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:49.714996 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b034f887-6685-41a3-a3d6-580f6f0f9b1a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:49.715605 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b034f887-6685-41a3-a3d6-580f6f0f9b1a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:49.823613 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6ee527b6-49bd-4965-83a6-07e5a1987f73 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:49.832885 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6ee527b6-49bd-4965-83a6-07e5a1987f73 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1723 microversion: 2.1 time: 0.193154 Jun 06 13:12:49.833466 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 291/601] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:49 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1723 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:49.867629 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b034f887-6685-41a3-a3d6-580f6f0f9b1a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:49.882879 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b034f887-6685-41a3-a3d6-580f6f0f9b1a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1365 microversion: 2.1 time: 0.174117 Jun 06 13:12:49.882879 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 311/602] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:49 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1365 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:50.849919 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-630025c3-bde5-4a4c-a5a2-16ea6dd0876c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:50.850533 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-630025c3-bde5-4a4c-a5a2-16ea6dd0876c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:50.857362 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-630025c3-bde5-4a4c-a5a2-16ea6dd0876c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:50.858044 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-630025c3-bde5-4a4c-a5a2-16ea6dd0876c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:50.858983 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-630025c3-bde5-4a4c-a5a2-16ea6dd0876c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:50.860276 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-630025c3-bde5-4a4c-a5a2-16ea6dd0876c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:50.897499 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-68f1c7fa-23bb-46c6-9c8a-0aa8cdcf799a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:50.898099 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-68f1c7fa-23bb-46c6-9c8a-0aa8cdcf799a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:50.900052 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:50.906148 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-68f1c7fa-23bb-46c6-9c8a-0aa8cdcf799a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:50.907090 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-68f1c7fa-23bb-46c6-9c8a-0aa8cdcf799a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:50.908084 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-68f1c7fa-23bb-46c6-9c8a-0aa8cdcf799a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:50.908527 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-68f1c7fa-23bb-46c6-9c8a-0aa8cdcf799a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:51.095108 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-630025c3-bde5-4a4c-a5a2-16ea6dd0876c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:51.099201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-68f1c7fa-23bb-46c6-9c8a-0aa8cdcf799a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:51.105103 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-630025c3-bde5-4a4c-a5a2-16ea6dd0876c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1723 microversion: 2.1 time: 0.258930 Jun 06 13:12:51.105700 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-68f1c7fa-23bb-46c6-9c8a-0aa8cdcf799a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1365 microversion: 2.1 time: 0.211879 Jun 06 13:12:51.106219 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 292/603] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:50 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1723 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:51.106609 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 312/604] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:50 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1365 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:51.119917 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-390bb876-7570-49af-b07d-2430ff56a06e req-a9ec903d-490e-4f7b-b7db-bdea44311126 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70800c6-f31a-4b07-9a99-98a2e5ff905c", "tag": "b6f802cc-0b4f-47e5-b3f9-802ff41af6df"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:51.129009 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-390bb876-7570-49af-b07d-2430ff56a06e req-a9ec903d-490e-4f7b-b7db-bdea44311126 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:51.129620 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-390bb876-7570-49af-b07d-2430ff56a06e req-a9ec903d-490e-4f7b-b7db-bdea44311126 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:51.141743 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-390bb876-7570-49af-b07d-2430ff56a06e req-a9ec903d-490e-4f7b-b7db-bdea44311126 service nova] Creating event network-changed:b6f802cc-0b4f-47e5-b3f9-802ff41af6df for instance d70800c6-f31a-4b07-9a99-98a2e5ff905c on hv-cinder-75510 Jun 06 13:12:51.146836 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-390bb876-7570-49af-b07d-2430ff56a06e req-a9ec903d-490e-4f7b-b7db-bdea44311126 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039065 Jun 06 13:12:51.147782 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 293/605] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:12:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:52.124022 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9f89a99b-7753-45c5-b04c-7af74b387d8f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:52.124636 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9f89a99b-7753-45c5-b04c-7af74b387d8f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:52.125824 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e927bf2d-f35e-457d-9633-cf6e4b7cb3f0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:52.126744 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e927bf2d-f35e-457d-9633-cf6e4b7cb3f0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:52.132959 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f89a99b-7753-45c5-b04c-7af74b387d8f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:52.133171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e927bf2d-f35e-457d-9633-cf6e4b7cb3f0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:52.133555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e927bf2d-f35e-457d-9633-cf6e4b7cb3f0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:52.133671 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f89a99b-7753-45c5-b04c-7af74b387d8f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:52.134330 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e927bf2d-f35e-457d-9633-cf6e4b7cb3f0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:52.134502 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f89a99b-7753-45c5-b04c-7af74b387d8f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:52.134797 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e927bf2d-f35e-457d-9633-cf6e4b7cb3f0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:52.134943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f89a99b-7753-45c5-b04c-7af74b387d8f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:52.352978 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9f89a99b-7753-45c5-b04c-7af74b387d8f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:52.360657 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e927bf2d-f35e-457d-9633-cf6e4b7cb3f0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:52.364067 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9f89a99b-7753-45c5-b04c-7af74b387d8f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1365 microversion: 2.1 time: 0.243879 Jun 06 13:12:52.364854 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 313/606] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:52 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1365 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:52.369098 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e927bf2d-f35e-457d-9633-cf6e4b7cb3f0 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1729 microversion: 2.1 time: 0.248741 Jun 06 13:12:52.369751 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 294/607] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:52 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1729 bytes in 250 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:12:52.386348 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a1d703ee-ffdb-464e-9e31-792b33cae2f1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:52.386907 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a1d703ee-ffdb-464e-9e31-792b33cae2f1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:52.393307 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1d703ee-ffdb-464e-9e31-792b33cae2f1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:52.394412 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1d703ee-ffdb-464e-9e31-792b33cae2f1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:52.395240 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1d703ee-ffdb-464e-9e31-792b33cae2f1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:52.395858 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1d703ee-ffdb-464e-9e31-792b33cae2f1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:52.474307 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a1d703ee-ffdb-464e-9e31-792b33cae2f1 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.091820 Jun 06 13:12:52.474837 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 314/608] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 13:12:52 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-interface => generated 284 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:53.381912 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-be5a96c6-8543-4c5a-9ceb-a3ef6ac49f5f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:53.382520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-be5a96c6-8543-4c5a-9ceb-a3ef6ac49f5f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:53.389185 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-be5a96c6-8543-4c5a-9ceb-a3ef6ac49f5f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:53.389640 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-be5a96c6-8543-4c5a-9ceb-a3ef6ac49f5f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:53.390405 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-be5a96c6-8543-4c5a-9ceb-a3ef6ac49f5f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:53.391594 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-be5a96c6-8543-4c5a-9ceb-a3ef6ac49f5f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:53.495596 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-e8b71414-f72b-47b2-9ad3-e0ac0361c1ac req-5c56e875-260e-4ec8-b7b1-8d6f4dec1358 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed", "tag": "f0e7842e-73e3-4514-a0b0-f79d3d8a84f2"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:53.505298 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-e8b71414-f72b-47b2-9ad3-e0ac0361c1ac req-5c56e875-260e-4ec8-b7b1-8d6f4dec1358 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:53.505725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-e8b71414-f72b-47b2-9ad3-e0ac0361c1ac req-5c56e875-260e-4ec8-b7b1-8d6f4dec1358 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:53.518048 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-e8b71414-f72b-47b2-9ad3-e0ac0361c1ac req-5c56e875-260e-4ec8-b7b1-8d6f4dec1358 service nova] Creating event network-changed:f0e7842e-73e3-4514-a0b0-f79d3d8a84f2 for instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed on hv-cinder-75510 Jun 06 13:12:53.523247 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-e8b71414-f72b-47b2-9ad3-e0ac0361c1ac req-5c56e875-260e-4ec8-b7b1-8d6f4dec1358 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031836 Jun 06 13:12:53.523901 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 315/609] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:12:53 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:12:53.570138 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-be5a96c6-8543-4c5a-9ceb-a3ef6ac49f5f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:53.577569 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-be5a96c6-8543-4c5a-9ceb-a3ef6ac49f5f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1365 microversion: 2.1 time: 0.199551 Jun 06 13:12:53.578135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 295/610] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:53 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1365 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:54.595870 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bf83dad6-2ddd-432f-880d-d59a6f42ff0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:54.596549 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bf83dad6-2ddd-432f-880d-d59a6f42ff0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:54.602744 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bf83dad6-2ddd-432f-880d-d59a6f42ff0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:54.603182 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bf83dad6-2ddd-432f-880d-d59a6f42ff0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:54.603954 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bf83dad6-2ddd-432f-880d-d59a6f42ff0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:54.604379 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bf83dad6-2ddd-432f-880d-d59a6f42ff0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:54.731762 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bf83dad6-2ddd-432f-880d-d59a6f42ff0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:54.739455 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bf83dad6-2ddd-432f-880d-d59a6f42ff0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1365 microversion: 2.1 time: 0.148950 Jun 06 13:12:54.740051 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 316/611] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:54 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1365 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:55.538518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-43ce20e4-ee87-4fb3-a8c5-3c9a6c0d2fc7 req-b18232c8-4dea-406e-af58-e06cc309d54a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed", "tag": "f0e7842e-73e3-4514-a0b0-f79d3d8a84f2"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:55.542566 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:55.543240 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=6 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:55.549359 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-43ce20e4-ee87-4fb3-a8c5-3c9a6c0d2fc7 req-b18232c8-4dea-406e-af58-e06cc309d54a service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:55.549788 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-43ce20e4-ee87-4fb3-a8c5-3c9a6c0d2fc7 req-b18232c8-4dea-406e-af58-e06cc309d54a service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:55.560701 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-43ce20e4-ee87-4fb3-a8c5-3c9a6c0d2fc7 req-b18232c8-4dea-406e-af58-e06cc309d54a service nova] Creating event network-changed:f0e7842e-73e3-4514-a0b0-f79d3d8a84f2 for instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed on hv-cinder-75510 Jun 06 13:12:55.566051 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-43ce20e4-ee87-4fb3-a8c5-3c9a6c0d2fc7 req-b18232c8-4dea-406e-af58-e06cc309d54a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031470 Jun 06 13:12:55.566650 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 296/612] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:12:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:55.756786 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0936f767-5eff-4103-b4df-b096cc8eec5c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:55.757391 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0936f767-5eff-4103-b4df-b096cc8eec5c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:55.759351 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:55.765725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0936f767-5eff-4103-b4df-b096cc8eec5c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:55.766370 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0936f767-5eff-4103-b4df-b096cc8eec5c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:55.767229 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0936f767-5eff-4103-b4df-b096cc8eec5c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:55.767856 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0936f767-5eff-4103-b4df-b096cc8eec5c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:55.901544 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0936f767-5eff-4103-b4df-b096cc8eec5c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:55.915232 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0936f767-5eff-4103-b4df-b096cc8eec5c tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1365 microversion: 2.1 time: 0.162358 Jun 06 13:12:55.915837 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 317/613] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:55 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1365 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:56.934944 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-76153bee-3709-43be-9fc9-e3b9fd6eecb7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:56.935749 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-76153bee-3709-43be-9fc9-e3b9fd6eecb7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:56.943519 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-76153bee-3709-43be-9fc9-e3b9fd6eecb7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:56.944060 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-76153bee-3709-43be-9fc9-e3b9fd6eecb7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:56.944884 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-76153bee-3709-43be-9fc9-e3b9fd6eecb7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:56.945318 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-76153bee-3709-43be-9fc9-e3b9fd6eecb7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:57.090499 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-76153bee-3709-43be-9fc9-e3b9fd6eecb7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:57.099122 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-76153bee-3709-43be-9fc9-e3b9fd6eecb7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1365 microversion: 2.1 time: 0.169563 Jun 06 13:12:57.099755 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 297/614] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:56 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1365 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:58.116533 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-51b3b1f6-949e-4251-b2f7-d89b1ab65747 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:58.117070 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-51b3b1f6-949e-4251-b2f7-d89b1ab65747 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:58.123682 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-51b3b1f6-949e-4251-b2f7-d89b1ab65747 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:58.124137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-51b3b1f6-949e-4251-b2f7-d89b1ab65747 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:58.124896 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-51b3b1f6-949e-4251-b2f7-d89b1ab65747 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:58.125857 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-51b3b1f6-949e-4251-b2f7-d89b1ab65747 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:58.252689 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-51b3b1f6-949e-4251-b2f7-d89b1ab65747 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:58.260100 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-51b3b1f6-949e-4251-b2f7-d89b1ab65747 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1365 microversion: 2.1 time: 0.147612 Jun 06 13:12:58.260663 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 318/615] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:58 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1365 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:12:59.254460 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-1be380e9-4a3b-49f6-b9d2-70c845f4818f req-6193b4fd-609c-4aee-b9cb-40367613fe1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70800c6-f31a-4b07-9a99-98a2e5ff905c", "name": "network-vif-plugged", "status": "completed", "tag": "b6f802cc-0b4f-47e5-b3f9-802ff41af6df"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:12:59.262905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-1be380e9-4a3b-49f6-b9d2-70c845f4818f req-6193b4fd-609c-4aee-b9cb-40367613fe1c service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:59.263337 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-1be380e9-4a3b-49f6-b9d2-70c845f4818f req-6193b4fd-609c-4aee-b9cb-40367613fe1c service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:59.274190 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-1be380e9-4a3b-49f6-b9d2-70c845f4818f req-6193b4fd-609c-4aee-b9cb-40367613fe1c service nova] Creating event network-vif-plugged:b6f802cc-0b4f-47e5-b3f9-802ff41af6df for instance d70800c6-f31a-4b07-9a99-98a2e5ff905c on hv-cinder-75510 Jun 06 13:12:59.277068 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-799df5fe-99a5-49f3-addb-5ccaa42999b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:12:59.277676 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-799df5fe-99a5-49f3-addb-5ccaa42999b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:12:59.279459 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-1be380e9-4a3b-49f6-b9d2-70c845f4818f req-6193b4fd-609c-4aee-b9cb-40367613fe1c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029336 Jun 06 13:12:59.280072 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 298/616] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:12:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:12:59.289034 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-799df5fe-99a5-49f3-addb-5ccaa42999b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:59.289034 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-799df5fe-99a5-49f3-addb-5ccaa42999b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:59.289034 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-799df5fe-99a5-49f3-addb-5ccaa42999b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:12:59.289034 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-799df5fe-99a5-49f3-addb-5ccaa42999b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:12:59.301636 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:12:59.422962 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-799df5fe-99a5-49f3-addb-5ccaa42999b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:12:59.430835 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-799df5fe-99a5-49f3-addb-5ccaa42999b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1365 microversion: 2.1 time: 0.157682 Jun 06 13:12:59.431405 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 319/617] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:12:59 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:13:00.449195 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fe2b54ae-2c76-4c22-9516-453b7c99d56a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:00.449883 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-fe2b54ae-2c76-4c22-9516-453b7c99d56a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:00.457534 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe2b54ae-2c76-4c22-9516-453b7c99d56a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:00.457977 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe2b54ae-2c76-4c22-9516-453b7c99d56a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:00.458735 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe2b54ae-2c76-4c22-9516-453b7c99d56a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:00.459212 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe2b54ae-2c76-4c22-9516-453b7c99d56a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:00.589714 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-fe2b54ae-2c76-4c22-9516-453b7c99d56a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:00.592131 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:00.598589 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-fe2b54ae-2c76-4c22-9516-453b7c99d56a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1365 microversion: 2.1 time: 0.153496 Jun 06 13:13:00.599253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 299/618] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:00 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1365 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:01.537711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7b768755-a8eb-40ef-9b33-9fd2b58f12ac tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:01.538286 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7b768755-a8eb-40ef-9b33-9fd2b58f12ac tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:01.545279 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7b768755-a8eb-40ef-9b33-9fd2b58f12ac tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:01.545732 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7b768755-a8eb-40ef-9b33-9fd2b58f12ac tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:01.546489 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7b768755-a8eb-40ef-9b33-9fd2b58f12ac tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:01.546922 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7b768755-a8eb-40ef-9b33-9fd2b58f12ac tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:01.576645 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7b768755-a8eb-40ef-9b33-9fd2b58f12ac tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments/59b71dc2-0bb4-495b-b8cc-a12e8a7597e4" status: 200 len: 194 microversion: 2.20 time: 0.043175 Jun 06 13:13:01.577212 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 320/619] 10.222.0.13 () {60 vars in 1453 bytes} [Mon Jun 6 13:13:01 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments/59b71dc2-0bb4-495b-b8cc-a12e8a7597e4 => generated 194 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:13:01.615374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2e70d851-bc61-4d35-9125-d9ad2f768deb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:01.616024 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2e70d851-bc61-4d35-9125-d9ad2f768deb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:01.623206 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2e70d851-bc61-4d35-9125-d9ad2f768deb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:01.623520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2e70d851-bc61-4d35-9125-d9ad2f768deb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:01.624381 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2e70d851-bc61-4d35-9125-d9ad2f768deb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:01.624806 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2e70d851-bc61-4d35-9125-d9ad2f768deb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:01.640540 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-79b43eb8-ab2e-4006-95b2-61863c7f8132 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:01.641034 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-79b43eb8-ab2e-4006-95b2-61863c7f8132 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:01.648008 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79b43eb8-ab2e-4006-95b2-61863c7f8132 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:01.648457 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79b43eb8-ab2e-4006-95b2-61863c7f8132 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:01.649224 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79b43eb8-ab2e-4006-95b2-61863c7f8132 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:01.649660 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79b43eb8-ab2e-4006-95b2-61863c7f8132 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:01.761873 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-2e70d851-bc61-4d35-9125-d9ad2f768deb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:01.770732 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2e70d851-bc61-4d35-9125-d9ad2f768deb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1365 microversion: 2.1 time: 0.159237 Jun 06 13:13:01.771319 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 300/620] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:01 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1365 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:01.780665 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-79b43eb8-ab2e-4006-95b2-61863c7f8132 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lazy-loading 'services' on Instance uuid 8fc5ce11-0a01-44fd-9be7-c095a8254551 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:13:02.055662 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-79b43eb8-ab2e-4006-95b2-61863c7f8132 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments/59b71dc2-0bb4-495b-b8cc-a12e8a7597e4" status: 202 len: 0 microversion: 2.20 time: 0.418908 Jun 06 13:13:02.056251 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 321/621] 10.222.0.13 () {60 vars in 1456 bytes} [Mon Jun 6 13:13:01 2022] DELETE /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments/59b71dc2-0bb4-495b-b8cc-a12e8a7597e4 => generated 0 bytes in 420 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Jun 06 13:13:02.064536 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c3e74ff4-b819-43cc-92c2-6fcd91615ba4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:02.065505 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c3e74ff4-b819-43cc-92c2-6fcd91615ba4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:02.071736 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c3e74ff4-b819-43cc-92c2-6fcd91615ba4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:02.072131 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c3e74ff4-b819-43cc-92c2-6fcd91615ba4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:02.072893 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c3e74ff4-b819-43cc-92c2-6fcd91615ba4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:02.073323 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c3e74ff4-b819-43cc-92c2-6fcd91615ba4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:02.105397 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c3e74ff4-b819-43cc-92c2-6fcd91615ba4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.044816 Jun 06 13:13:02.106035 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 301/622] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jun 6 13:13:02 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:13:02.788848 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0ae62f26-204b-4703-a30e-f75843280f88 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:02.789532 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0ae62f26-204b-4703-a30e-f75843280f88 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:02.796398 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ae62f26-204b-4703-a30e-f75843280f88 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:02.796838 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ae62f26-204b-4703-a30e-f75843280f88 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:02.798209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ae62f26-204b-4703-a30e-f75843280f88 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:02.798679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ae62f26-204b-4703-a30e-f75843280f88 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:02.929306 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0ae62f26-204b-4703-a30e-f75843280f88 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:02.936757 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0ae62f26-204b-4703-a30e-f75843280f88 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1365 microversion: 2.1 time: 0.152331 Jun 06 13:13:02.937644 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 322/623] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:02 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1365 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:03.117294 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a34a77b4-ab09-4fca-8781-e7b2ce15d5f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:03.118242 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a34a77b4-ab09-4fca-8781-e7b2ce15d5f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:03.124818 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a34a77b4-ab09-4fca-8781-e7b2ce15d5f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:03.125267 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a34a77b4-ab09-4fca-8781-e7b2ce15d5f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:03.126349 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a34a77b4-ab09-4fca-8781-e7b2ce15d5f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:03.126823 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a34a77b4-ab09-4fca-8781-e7b2ce15d5f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:03.159078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a34a77b4-ab09-4fca-8781-e7b2ce15d5f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045740 Jun 06 13:13:03.163414 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 302/624] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jun 6 13:13:03 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:13:03.955452 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-86e30bf7-8666-46be-b17d-1c8eb847fb64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:03.956072 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-86e30bf7-8666-46be-b17d-1c8eb847fb64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:03.962542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-86e30bf7-8666-46be-b17d-1c8eb847fb64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:03.962979 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-86e30bf7-8666-46be-b17d-1c8eb847fb64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:03.963757 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-86e30bf7-8666-46be-b17d-1c8eb847fb64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:03.964184 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-86e30bf7-8666-46be-b17d-1c8eb847fb64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:04.096203 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-86e30bf7-8666-46be-b17d-1c8eb847fb64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:04.103627 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-86e30bf7-8666-46be-b17d-1c8eb847fb64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1555 microversion: 2.1 time: 0.152826 Jun 06 13:13:04.104255 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 323/625] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:03 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1555 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:04.123260 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0b72f534-5f64-479c-85b8-1c4c63b8f28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:04.123859 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0b72f534-5f64-479c-85b8-1c4c63b8f28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:04.130848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0b72f534-5f64-479c-85b8-1c4c63b8f28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:04.131294 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0b72f534-5f64-479c-85b8-1c4c63b8f28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:04.132094 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0b72f534-5f64-479c-85b8-1c4c63b8f28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:04.132527 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0b72f534-5f64-479c-85b8-1c4c63b8f28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:04.170855 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ae376ee4-238f-44b6-bb77-dc92a90f4ad0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:04.171789 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ae376ee4-238f-44b6-bb77-dc92a90f4ad0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:04.177877 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ae376ee4-238f-44b6-bb77-dc92a90f4ad0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:04.178317 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ae376ee4-238f-44b6-bb77-dc92a90f4ad0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:04.179117 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ae376ee4-238f-44b6-bb77-dc92a90f4ad0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:04.179558 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ae376ee4-238f-44b6-bb77-dc92a90f4ad0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:04.212754 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ae376ee4-238f-44b6-bb77-dc92a90f4ad0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045932 Jun 06 13:13:04.213316 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 324/626] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jun 6 13:13:04 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 13:13:04.220928 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0b72f534-5f64-479c-85b8-1c4c63b8f28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.101405 Jun 06 13:13:04.224842 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 303/627] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 13:13:04 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-interface => generated 284 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:05.225363 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a302b420-440d-470b-9aec-34150006dc23 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:05.226123 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a302b420-440d-470b-9aec-34150006dc23 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:05.232670 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a302b420-440d-470b-9aec-34150006dc23 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:05.234795 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a302b420-440d-470b-9aec-34150006dc23 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:05.234795 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a302b420-440d-470b-9aec-34150006dc23 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:05.234795 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a302b420-440d-470b-9aec-34150006dc23 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:05.263166 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a302b420-440d-470b-9aec-34150006dc23 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.042035 Jun 06 13:13:05.264924 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 325/628] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jun 6 13:13:05 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 13:13:05.440167 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-98ea047d-659c-4c41-92a7-44565d003eb7 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:05.441333 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-98ea047d-659c-4c41-92a7-44565d003eb7 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:05.456439 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-a2ee1e70-6c3a-4952-a338-bfc3415d1466 req-350bae5d-3fd0-4ce9-abb5-b38a4ca400a1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d70800c6-f31a-4b07-9a99-98a2e5ff905c", "tag": "b6f802cc-0b4f-47e5-b3f9-802ff41af6df"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:05.461173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-98ea047d-659c-4c41-92a7-44565d003eb7 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:05.461702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-98ea047d-659c-4c41-92a7-44565d003eb7 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:05.462730 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-98ea047d-659c-4c41-92a7-44565d003eb7 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:05.463372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-98ea047d-659c-4c41-92a7-44565d003eb7 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:05.464562 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-a2ee1e70-6c3a-4952-a338-bfc3415d1466 req-350bae5d-3fd0-4ce9-abb5-b38a4ca400a1 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:05.465387 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-a2ee1e70-6c3a-4952-a338-bfc3415d1466 req-350bae5d-3fd0-4ce9-abb5-b38a4ca400a1 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:05.477493 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-a2ee1e70-6c3a-4952-a338-bfc3415d1466 req-350bae5d-3fd0-4ce9-abb5-b38a4ca400a1 service nova] Creating event network-changed:b6f802cc-0b4f-47e5-b3f9-802ff41af6df for instance d70800c6-f31a-4b07-9a99-98a2e5ff905c on hv-cinder-75510 Jun 06 13:13:05.482774 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-a2ee1e70-6c3a-4952-a338-bfc3415d1466 req-350bae5d-3fd0-4ce9-abb5-b38a4ca400a1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033447 Jun 06 13:13:05.488478 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 326/629] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:05.490508 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9be312d5-2cbc-4327-a4a7-fae9d6a9de30 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:05.491413 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9be312d5-2cbc-4327-a4a7-fae9d6a9de30 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:05.499262 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9be312d5-2cbc-4327-a4a7-fae9d6a9de30 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:05.499940 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9be312d5-2cbc-4327-a4a7-fae9d6a9de30 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:05.501680 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9be312d5-2cbc-4327-a4a7-fae9d6a9de30 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:05.502282 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9be312d5-2cbc-4327-a4a7-fae9d6a9de30 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:05.614106 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-9be312d5-2cbc-4327-a4a7-fae9d6a9de30 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lazy-loading 'services' on Instance uuid c80076dd-2d71-451c-b869-d14a0f507ac7 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:13:05.631043 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-98ea047d-659c-4c41-92a7-44565d003eb7 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:05.639330 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-98ea047d-659c-4c41-92a7-44565d003eb7 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1591 microversion: 2.1 time: 0.203376 Jun 06 13:13:05.668207 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 304/630] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:05 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1591 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:05.850521 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9be312d5-2cbc-4327-a4a7-fae9d6a9de30 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7/os-volume_attachments/1757d5f9-0918-4599-b6e1-5e5da7a0f32e" status: 202 len: 0 microversion: 2.1 time: 0.365546 Jun 06 13:13:05.854728 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 327/631] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 13:13:05 2022] DELETE /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7/os-volume_attachments/1757d5f9-0918-4599-b6e1-5e5da7a0f32e => generated 0 bytes in 367 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:13:06.275907 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f518c37a-07e3-442b-8ec9-c7036d9e210c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:06.277036 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f518c37a-07e3-442b-8ec9-c7036d9e210c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:06.285320 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f518c37a-07e3-442b-8ec9-c7036d9e210c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:06.286393 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f518c37a-07e3-442b-8ec9-c7036d9e210c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:06.287777 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f518c37a-07e3-442b-8ec9-c7036d9e210c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:06.288323 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f518c37a-07e3-442b-8ec9-c7036d9e210c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:06.322636 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f518c37a-07e3-442b-8ec9-c7036d9e210c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.050696 Jun 06 13:13:06.323335 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 305/632] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jun 6 13:13:06 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551/os-volume_attachments => generated 25 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:06.383439 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0204ccd1-a2fe-4417-a788-a176ddf71e81 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:06.384046 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0204ccd1-a2fe-4417-a788-a176ddf71e81 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:06.390500 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0204ccd1-a2fe-4417-a788-a176ddf71e81 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:06.390946 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0204ccd1-a2fe-4417-a788-a176ddf71e81 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:06.392496 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0204ccd1-a2fe-4417-a788-a176ddf71e81 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:06.392932 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0204ccd1-a2fe-4417-a788-a176ddf71e81 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:06.429098 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0204ccd1-a2fe-4417-a788-a176ddf71e81 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:13:06.896453 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0204ccd1-a2fe-4417-a788-a176ddf71e81 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 204 len: 0 microversion: 2.20 time: 0.517466 Jun 06 13:13:06.897266 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 328/633] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jun 6 13:13:06 2022] DELETE /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 0 bytes in 519 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 13:13:06.905318 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-abcf1d96-d973-482a-90ef-b82c0475e90a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:06.907510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-abcf1d96-d973-482a-90ef-b82c0475e90a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:06.919099 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abcf1d96-d973-482a-90ef-b82c0475e90a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:06.920497 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abcf1d96-d973-482a-90ef-b82c0475e90a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:06.921297 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abcf1d96-d973-482a-90ef-b82c0475e90a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:06.921736 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abcf1d96-d973-482a-90ef-b82c0475e90a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:07.131886 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-abcf1d96-d973-482a-90ef-b82c0475e90a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:07.139859 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-abcf1d96-d973-482a-90ef-b82c0475e90a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:07.141420 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-abcf1d96-d973-482a-90ef-b82c0475e90a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:07.142860 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-abcf1d96-d973-482a-90ef-b82c0475e90a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.241450 Jun 06 13:13:07.143422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 306/634] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:06 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:07.898681 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-e86acb35-4f73-466b-b44b-fc2909502623 req-e6ba2c38-07c5-49c8-9531-ff8db5dc0f00 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87090e23-8967-41e3-93f5-2c475fe348cf", "tag": "f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:07.908700 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-e86acb35-4f73-466b-b44b-fc2909502623 req-e6ba2c38-07c5-49c8-9531-ff8db5dc0f00 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:07.909148 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-e86acb35-4f73-466b-b44b-fc2909502623 req-e6ba2c38-07c5-49c8-9531-ff8db5dc0f00 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:07.923434 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-e86acb35-4f73-466b-b44b-fc2909502623 req-e6ba2c38-07c5-49c8-9531-ff8db5dc0f00 service nova] Creating event network-changed:f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb for instance 87090e23-8967-41e3-93f5-2c475fe348cf on hv-cinder-75510 Jun 06 13:13:07.928697 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-e86acb35-4f73-466b-b44b-fc2909502623 req-e6ba2c38-07c5-49c8-9531-ff8db5dc0f00 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034077 Jun 06 13:13:07.929413 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 329/635] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:13:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:08.036918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-339d7736-49c0-4b8f-b33d-2918dea1c45e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:08.037499 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-339d7736-49c0-4b8f-b33d-2918dea1c45e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:08.043727 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-339d7736-49c0-4b8f-b33d-2918dea1c45e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:08.044399 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-339d7736-49c0-4b8f-b33d-2918dea1c45e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:08.045971 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-339d7736-49c0-4b8f-b33d-2918dea1c45e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:08.046426 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-339d7736-49c0-4b8f-b33d-2918dea1c45e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:08.073607 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-339d7736-49c0-4b8f-b33d-2918dea1c45e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Going to try to terminate instance {{(pid=118134) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:13:08.163064 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d1e1a7c4-5ff2-424d-8aa6-901fc6875003 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:08.163938 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d1e1a7c4-5ff2-424d-8aa6-901fc6875003 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:08.170430 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d1e1a7c4-5ff2-424d-8aa6-901fc6875003 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:08.170879 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d1e1a7c4-5ff2-424d-8aa6-901fc6875003 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:08.171746 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d1e1a7c4-5ff2-424d-8aa6-901fc6875003 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:08.172179 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d1e1a7c4-5ff2-424d-8aa6-901fc6875003 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:08.308487 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d1e1a7c4-5ff2-424d-8aa6-901fc6875003 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:08.316977 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d1e1a7c4-5ff2-424d-8aa6-901fc6875003 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:08.318466 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d1e1a7c4-5ff2-424d-8aa6-901fc6875003 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:08.319666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d1e1a7c4-5ff2-424d-8aa6-901fc6875003 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.161393 Jun 06 13:13:08.320220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 330/636] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:08 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:13:08.444955 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-339d7736-49c0-4b8f-b33d-2918dea1c45e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "DELETE /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 204 len: 0 microversion: 2.1 time: 0.411936 Jun 06 13:13:08.447909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 307/637] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:13:08 2022] DELETE /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 0 bytes in 414 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:13:08.453874 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9dee4a78-238a-4359-9c34-4b0adab31f2c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:08.455079 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9dee4a78-238a-4359-9c34-4b0adab31f2c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:08.461101 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9dee4a78-238a-4359-9c34-4b0adab31f2c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:08.461547 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9dee4a78-238a-4359-9c34-4b0adab31f2c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:08.462311 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9dee4a78-238a-4359-9c34-4b0adab31f2c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:08.462742 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9dee4a78-238a-4359-9c34-4b0adab31f2c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:08.613183 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9dee4a78-238a-4359-9c34-4b0adab31f2c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:08.621993 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9dee4a78-238a-4359-9c34-4b0adab31f2c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1560 microversion: 2.1 time: 0.171912 Jun 06 13:13:08.622748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 331/638] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:08 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1560 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:09.338911 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a2781a44-6113-41f9-a55c-a0e64310d8fa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:09.339670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a2781a44-6113-41f9-a55c-a0e64310d8fa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:09.347174 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a2781a44-6113-41f9-a55c-a0e64310d8fa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:09.347668 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a2781a44-6113-41f9-a55c-a0e64310d8fa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:09.353371 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a2781a44-6113-41f9-a55c-a0e64310d8fa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:09.353371 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a2781a44-6113-41f9-a55c-a0e64310d8fa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:09.512604 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a2781a44-6113-41f9-a55c-a0e64310d8fa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:09.521949 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a2781a44-6113-41f9-a55c-a0e64310d8fa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:09.523561 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a2781a44-6113-41f9-a55c-a0e64310d8fa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:09.524713 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a2781a44-6113-41f9-a55c-a0e64310d8fa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.189991 Jun 06 13:13:09.529693 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 308/639] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:09 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:09.640961 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2b736cab-fa6e-44e0-b677-6804069d4a9e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:09.642066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2b736cab-fa6e-44e0-b677-6804069d4a9e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:09.648705 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b736cab-fa6e-44e0-b677-6804069d4a9e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:09.649150 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b736cab-fa6e-44e0-b677-6804069d4a9e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:09.649911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b736cab-fa6e-44e0-b677-6804069d4a9e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:09.650354 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b736cab-fa6e-44e0-b677-6804069d4a9e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:10.006823 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2b736cab-fa6e-44e0-b677-6804069d4a9e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:10.014369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2b736cab-fa6e-44e0-b677-6804069d4a9e tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1514 microversion: 2.1 time: 0.377309 Jun 06 13:13:10.014928 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 332/640] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:09 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1514 bytes in 379 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:10.544235 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a454320d-88e2-4241-9f19-be92ce388aa2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:10.545067 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a454320d-88e2-4241-9f19-be92ce388aa2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:10.551882 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a454320d-88e2-4241-9f19-be92ce388aa2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:10.552326 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a454320d-88e2-4241-9f19-be92ce388aa2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:10.553093 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a454320d-88e2-4241-9f19-be92ce388aa2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:10.553522 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a454320d-88e2-4241-9f19-be92ce388aa2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:10.688198 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a454320d-88e2-4241-9f19-be92ce388aa2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:10.697407 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a454320d-88e2-4241-9f19-be92ce388aa2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:10.698922 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a454320d-88e2-4241-9f19-be92ce388aa2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:10.700106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a454320d-88e2-4241-9f19-be92ce388aa2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1721 microversion: 2.20 time: 0.159820 Jun 06 13:13:10.700656 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 309/641] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:10 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:13:11.033837 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9722f42d-f521-4234-b18a-a1c3e3761a3c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:11.034636 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9722f42d-f521-4234-b18a-a1c3e3761a3c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:11.045934 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9722f42d-f521-4234-b18a-a1c3e3761a3c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:11.046386 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9722f42d-f521-4234-b18a-a1c3e3761a3c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:11.047164 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9722f42d-f521-4234-b18a-a1c3e3761a3c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:11.047624 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9722f42d-f521-4234-b18a-a1c3e3761a3c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:11.048812 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f160bc7e-ff0f-439e-b9ba-ab5c69c3a7ed tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-1974477596"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:11.049776 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f160bc7e-ff0f-439e-b9ba-ab5c69c3a7ed tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:11.057742 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f160bc7e-ff0f-439e-b9ba-ab5c69c3a7ed tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:11.058300 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f160bc7e-ff0f-439e-b9ba-ab5c69c3a7ed tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:11.059600 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f160bc7e-ff0f-439e-b9ba-ab5c69c3a7ed tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:11.061304 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f160bc7e-ff0f-439e-b9ba-ab5c69c3a7ed tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:11.325852 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9722f42d-f521-4234-b18a-a1c3e3761a3c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:11.334877 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9722f42d-f521-4234-b18a-a1c3e3761a3c tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1514 microversion: 2.1 time: 0.306437 Jun 06 13:13:11.335594 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 333/642] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:11 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1514 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:11.339964 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.network.security_group_api [None req-f160bc7e-ff0f-439e-b9ba-ab5c69c3a7ed tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Adding security group 3ac3d26a-e687-4180-87d4-c5cb7b90f24b to port f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb Jun 06 13:13:11.602443 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-cec5afb8-c209-4f07-b2d7-18cad56ad7c9 req-28ab6c75-8f65-4a43-bcf2-5d2e245db64e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c80076dd-2d71-451c-b869-d14a0f507ac7", "name": "network-vif-deleted", "tag": "22c6e2ec-7fcf-457c-991b-931ea9ea289f"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:11.611982 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-cec5afb8-c209-4f07-b2d7-18cad56ad7c9 req-28ab6c75-8f65-4a43-bcf2-5d2e245db64e service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:11.612747 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-cec5afb8-c209-4f07-b2d7-18cad56ad7c9 req-28ab6c75-8f65-4a43-bcf2-5d2e245db64e service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:11.624090 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-cec5afb8-c209-4f07-b2d7-18cad56ad7c9 req-28ab6c75-8f65-4a43-bcf2-5d2e245db64e service nova] Creating event network-vif-deleted:22c6e2ec-7fcf-457c-991b-931ea9ea289f for instance c80076dd-2d71-451c-b869-d14a0f507ac7 on hv-cinder-75510 Jun 06 13:13:11.631255 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-cec5afb8-c209-4f07-b2d7-18cad56ad7c9 req-28ab6c75-8f65-4a43-bcf2-5d2e245db64e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032578 Jun 06 13:13:11.631912 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 334/643] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:13:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:13:11.720288 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7652e91f-73c9-4d30-82da-3e4109a78821 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:11.721400 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7652e91f-73c9-4d30-82da-3e4109a78821 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:11.727892 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7652e91f-73c9-4d30-82da-3e4109a78821 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:11.728334 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7652e91f-73c9-4d30-82da-3e4109a78821 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:11.729125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7652e91f-73c9-4d30-82da-3e4109a78821 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:11.729570 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7652e91f-73c9-4d30-82da-3e4109a78821 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:11.733625 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=3,nova_cell1:UPDATE=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:11.811990 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7652e91f-73c9-4d30-82da-3e4109a78821 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:11.824856 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7652e91f-73c9-4d30-82da-3e4109a78821 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:11.827123 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7652e91f-73c9-4d30-82da-3e4109a78821 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:11.828372 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7652e91f-73c9-4d30-82da-3e4109a78821 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1653 microversion: 2.20 time: 0.113115 Jun 06 13:13:11.831999 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 335/644] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:11 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1653 bytes in 117 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:13:11.961919 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f160bc7e-ff0f-439e-b9ba-ab5c69c3a7ed tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "POST /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/action" status: 202 len: 0 microversion: 2.1 time: 0.918562 Jun 06 13:13:11.965824 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 310/645] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:13:11 2022] POST /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/action => generated 0 bytes in 920 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:13:11.972608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9c307018-e0ae-4fa4-8d71-17d51b1e9d11 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:11.973631 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9c307018-e0ae-4fa4-8d71-17d51b1e9d11 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:11.988376 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9c307018-e0ae-4fa4-8d71-17d51b1e9d11 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:11.989078 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9c307018-e0ae-4fa4-8d71-17d51b1e9d11 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:11.991615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9c307018-e0ae-4fa4-8d71-17d51b1e9d11 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:11.992316 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9c307018-e0ae-4fa4-8d71-17d51b1e9d11 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:12.143963 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-371ae3d8-a630-4416-9939-5cfe56bdfbc0 req-c82f05c1-b1a2-4d4c-adab-0bfa59702c7a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8fc5ce11-0a01-44fd-9be7-c095a8254551", "name": "network-vif-deleted", "tag": "5fd26d76-0c93-4177-8c73-21f7779282ef"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:12.155109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-371ae3d8-a630-4416-9939-5cfe56bdfbc0 req-c82f05c1-b1a2-4d4c-adab-0bfa59702c7a service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:12.155629 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-371ae3d8-a630-4416-9939-5cfe56bdfbc0 req-c82f05c1-b1a2-4d4c-adab-0bfa59702c7a service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:12.176856 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-371ae3d8-a630-4416-9939-5cfe56bdfbc0 req-c82f05c1-b1a2-4d4c-adab-0bfa59702c7a service nova] Creating event network-vif-deleted:5fd26d76-0c93-4177-8c73-21f7779282ef for instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 on hv-cinder-75510 Jun 06 13:13:12.185283 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-371ae3d8-a630-4416-9939-5cfe56bdfbc0 req-c82f05c1-b1a2-4d4c-adab-0bfa59702c7a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045399 Jun 06 13:13:12.187998 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 311/646] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:13:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:13:12.202418 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9c307018-e0ae-4fa4-8d71-17d51b1e9d11 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:12.212534 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9c307018-e0ae-4fa4-8d71-17d51b1e9d11 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1756 microversion: 2.1 time: 0.245284 Jun 06 13:13:12.213714 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 336/647] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:11 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1756 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:12.352703 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9c76ba38-6fd2-4daa-923a-41b492ea8f65 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:12.353321 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9c76ba38-6fd2-4daa-923a-41b492ea8f65 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:12.360199 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9c76ba38-6fd2-4daa-923a-41b492ea8f65 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:12.360878 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9c76ba38-6fd2-4daa-923a-41b492ea8f65 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:12.361835 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9c76ba38-6fd2-4daa-923a-41b492ea8f65 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:12.362089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9c76ba38-6fd2-4daa-923a-41b492ea8f65 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:12.399046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9c76ba38-6fd2-4daa-923a-41b492ea8f65 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:12.399635 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9c76ba38-6fd2-4daa-923a-41b492ea8f65 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:12.400162 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-9c76ba38-6fd2-4daa-923a-41b492ea8f65 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lazy-loading 'fault' on Instance uuid c80076dd-2d71-451c-b869-d14a0f507ac7 {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:13:12.451485 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9c76ba38-6fd2-4daa-923a-41b492ea8f65 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '593bba746dfc40dfbe768b4b9f0c78e3', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'c6c440914e0f40e49b9fc8ab9f4b6f48', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:12.460305 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9c76ba38-6fd2-4daa-923a-41b492ea8f65 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 200 len: 1308 microversion: 2.1 time: 0.111841 Jun 06 13:13:12.461656 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 312/648] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:12 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 1308 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:12.848359 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2bc912db-87b4-42c1-9942-1172d62ee64a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:12.848962 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2bc912db-87b4-42c1-9942-1172d62ee64a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:12.855466 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2bc912db-87b4-42c1-9942-1172d62ee64a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:12.855938 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2bc912db-87b4-42c1-9942-1172d62ee64a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:12.856696 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2bc912db-87b4-42c1-9942-1172d62ee64a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:12.857123 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2bc912db-87b4-42c1-9942-1172d62ee64a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:12.889444 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2bc912db-87b4-42c1-9942-1172d62ee64a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:12.889881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2bc912db-87b4-42c1-9942-1172d62ee64a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:12.890321 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-2bc912db-87b4-42c1-9942-1172d62ee64a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lazy-loading 'fault' on Instance uuid 8fc5ce11-0a01-44fd-9be7-c095a8254551 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:13:12.933773 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2bc912db-87b4-42c1-9942-1172d62ee64a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:12.941963 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2bc912db-87b4-42c1-9942-1172d62ee64a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:12.943592 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2bc912db-87b4-42c1-9942-1172d62ee64a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:12.944762 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2bc912db-87b4-42c1-9942-1172d62ee64a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 200 len: 1369 microversion: 2.20 time: 0.101260 Jun 06 13:13:12.945407 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 337/649] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:12 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 1369 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:13:13.478271 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3f0d3dc5-1a4b-463f-bf74-677c2fb52ed5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:13.478792 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3f0d3dc5-1a4b-463f-bf74-677c2fb52ed5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] [instance: c80076dd-2d71-451c-b869-d14a0f507ac7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:13.485819 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3f0d3dc5-1a4b-463f-bf74-677c2fb52ed5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:13.486901 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3f0d3dc5-1a4b-463f-bf74-677c2fb52ed5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:13.488012 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3f0d3dc5-1a4b-463f-bf74-677c2fb52ed5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:13.488452 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3f0d3dc5-1a4b-463f-bf74-677c2fb52ed5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:13.504207 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-3f0d3dc5-1a4b-463f-bf74-677c2fb52ed5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] HTTP exception thrown: Instance c80076dd-2d71-451c-b869-d14a0f507ac7 could not be found. Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3f0d3dc5-1a4b-463f-bf74-677c2fb52ed5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Request method failure captured: Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 HTTP/1.1 Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfy2ALTj8614tDK9nvfLJTMxRvHnJcNYms76r5s3r3Ka6Wnis2ftex8lauSKk1rYNKTETZUEisNGVLiwsBB7fBQ8uePYzdBI0grEgOLiwyZwNOZ7zzIn1dIHtgCeOkgjsDDyz4rSoCvfhyYPfr1pHjL9_6Ec5PvHmQOVuRTAN7_8Z1k Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: c6c440914e0f40e49b9fc8ab9f4b6f48 Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-VolumesSnapshotTestJSON-2115950294 Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:13:13.505685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:13:13.507341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_c6c440914e0f40e49b9fc8ab9f4b6f48", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6c440914e0f40e49b9fc8ab9f4b6f48"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/c6c440914e0f40e49b9fc8ab9f4b6f48"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/c6c440914e0f40e49b9fc8ab9f4b6f48"}]}] Jun 06 13:13:13.507341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-VolumesSnapshotTestJSON-2115950294 Jun 06 13:13:13.507341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: c6c440914e0f40e49b9fc8ab9f4b6f48 Jun 06 13:13:13.507341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-2115950294 Jun 06 13:13:13.507341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-VolumesSnapshotTestJSON-2115950294-project Jun 06 13:13:13.507341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:13:13.507341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:13:13.507341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 593bba746dfc40dfbe768b4b9f0c78e3 Jun 06 13:13:13.507341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-VolumesSnapshotTestJSON-2115950294-project Jun 06 13:13:13.507341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:13:13.507341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance c80076dd-2d71-451c-b869-d14a0f507ac7 could not be found. Jun 06 13:13:13.507341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': 'c80076dd-2d71-451c-b869-d14a0f507ac7'} Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c80076dd-2d71-451c-b869-d14a0f507ac7 could not be found. Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:13:13.508137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c80076dd-2d71-451c-b869-d14a0f507ac7 could not be found. Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c80076dd-2d71-451c-b869-d14a0f507ac7 could not be found. Jun 06 13:13:13.509372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:13:13.511264 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3f0d3dc5-1a4b-463f-bf74-677c2fb52ed5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] Returning 404 to user: Instance c80076dd-2d71-451c-b869-d14a0f507ac7 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:13:13.512151 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3f0d3dc5-1a4b-463f-bf74-677c2fb52ed5 tempest-VolumesSnapshotTestJSON-2115950294 tempest-VolumesSnapshotTestJSON-2115950294-project] 10.222.0.13 "GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7" status: 404 len: 111 microversion: 2.1 time: 0.037899 Jun 06 13:13:13.512711 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 313/650] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:13 2022] GET /compute/v2.1/servers/c80076dd-2d71-451c-b869-d14a0f507ac7 => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:13:13.650769 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-4862e8a6-e386-4b27-afd5-6b1ad7dc251f req-04b69c61-f6a0-4283-a5a1-bfc94db6ef7f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87090e23-8967-41e3-93f5-2c475fe348cf", "tag": "f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:13.660087 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-4862e8a6-e386-4b27-afd5-6b1ad7dc251f req-04b69c61-f6a0-4283-a5a1-bfc94db6ef7f service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:13.660523 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-4862e8a6-e386-4b27-afd5-6b1ad7dc251f req-04b69c61-f6a0-4283-a5a1-bfc94db6ef7f service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:13.671904 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-4862e8a6-e386-4b27-afd5-6b1ad7dc251f req-04b69c61-f6a0-4283-a5a1-bfc94db6ef7f service nova] Creating event network-changed:f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb for instance 87090e23-8967-41e3-93f5-2c475fe348cf on hv-cinder-75510 Jun 06 13:13:13.677197 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-4862e8a6-e386-4b27-afd5-6b1ad7dc251f req-04b69c61-f6a0-4283-a5a1-bfc94db6ef7f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029883 Jun 06 13:13:13.680924 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 338/651] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:13.963828 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3d77e384-4abb-4ebc-a27d-3b14f30097b6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:13.964436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3d77e384-4abb-4ebc-a27d-3b14f30097b6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:13.970645 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d77e384-4abb-4ebc-a27d-3b14f30097b6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:13.971085 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d77e384-4abb-4ebc-a27d-3b14f30097b6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:13.971887 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d77e384-4abb-4ebc-a27d-3b14f30097b6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:13.972315 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d77e384-4abb-4ebc-a27d-3b14f30097b6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:13.987049 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-3d77e384-4abb-4ebc-a27d-3b14f30097b6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] HTTP exception thrown: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3d77e384-4abb-4ebc-a27d-3b14f30097b6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Request method failure captured: Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 HTTP/1.1 Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxY0b8lxaR7WehSTVZR5G93jLntY1qQUQSNkURQ8TWHJ6jMHhO2XpEtR95f4dv912W6NJjGIhwThfj6wKqyXoEpTdPq31gXBeyUdMJ9IICKcS6U0BIvqMQe-fBmmsmlqOy3rVYJeW31bL8EmVOSggmZNaZ-n_DFd9lUPCKGQ6sRjHs Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 217a93e9314e4b06ae49a36a9969e22e Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:13:13.988910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:13:13.993436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_217a93e9314e4b06ae49a36a9969e22e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/217a93e9314e4b06ae49a36a9969e22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/217a93e9314e4b06ae49a36a9969e22e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/217a93e9314e4b06ae49a36a9969e22e"}]}] Jun 06 13:13:13.993436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:13:13.993436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 217a93e9314e4b06ae49a36a9969e22e Jun 06 13:13:13.993436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:13:13.993436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeShelveTestJSON-1209920443-project Jun 06 13:13:13.993436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:13:13.993436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:13:13.993436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 15aec8f2f71e4084a21cc0cfc3a52bd2 Jun 06 13:13:13.993436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1209920443-project Jun 06 13:13:13.993436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:13:13.993436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:13:13.993436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '8fc5ce11-0a01-44fd-9be7-c095a8254551'} Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:13:13.994506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:13:13.995726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:13:13.997953 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3d77e384-4abb-4ebc-a27d-3b14f30097b6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Returning 404 to user: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:13:13.997953 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3d77e384-4abb-4ebc-a27d-3b14f30097b6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 404 len: 111 microversion: 2.20 time: 0.030728 Jun 06 13:13:13.997953 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 314/652] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:13 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 13:13:14.000367 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-034cd999-9725-4ae7-a6e5-b90e1df094cb tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '.version_select at 0x7f0ef6ebc1f0>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:14.099484 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-034cd999-9725-4ae7-a6e5-b90e1df094cb tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-51552002" status: 204 len: 0 microversion: 2.20 time: 0.103345 Jun 06 13:13:14.100791 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 339/653] 10.222.0.13 () {60 vars in 1255 bytes} [Mon Jun 6 13:13:13 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-51552002 => generated 0 bytes in 106 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 13:13:14.887972 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0e278c75-baf2-44cf-b256-b41f93a83197 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Action: 'create', calling method: .version_select at 0x7f0efc1d4e50>, body: {"keypair": {"name": "tempest-keypair-1809104381", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJWOHdGd2Mgg55Gx0I9VCI/1y2n6bvDT5LvgOjBBqgjhkoDuSzcjxKLUHWneKP2MJl1i8mZxE+mCbIm1B/ZBCWGUjvSPkln82J9z8cc9w5ISf3yueyPrhp7/HcH0MS5+8w=="}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:14.902164 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-0e278c75-baf2-44cf-b256-b41f93a83197 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Getting quotas for project 217a93e9314e4b06ae49a36a9969e22e. Resources: {'key_pairs'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:13:14.907046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-0e278c75-baf2-44cf-b256-b41f93a83197 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Getting quotas for user 15aec8f2f71e4084a21cc0cfc3a52bd2 and project 217a93e9314e4b06ae49a36a9969e22e. Resources: {'key_pairs'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:13:15.000806 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0e278c75-baf2-44cf-b256-b41f93a83197 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.116446 Jun 06 13:13:15.002062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 315/654] 10.222.0.13 () {62 vars in 1199 bytes} [Mon Jun 6 13:13:14 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 119 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Jun 06 13:13:17.133569 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-729144481", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "47dfc8c5-ef77-41b0-a754-346b183b0265"}], "security_groups": [{"name": "tempest-securitygroup--776564034"}], "key_name": "tempest-keypair-1809104381", "user_data": "}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:17.140146 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=80,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:17.234835 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] validate_networks() for [('47dfc8c5-ef77-41b0-a754-346b183b0265', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:13:17.598203 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:13:17.598619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:13:17.599093 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:13:17.599496 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:13:17.599939 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:13:17.608713 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:17.609156 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:17.609956 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:17.610391 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:17.627090 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Getting quotas for project 217a93e9314e4b06ae49a36a9969e22e. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:13:17.631684 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Getting quotas for user 15aec8f2f71e4084a21cc0cfc3a52bd2 and project 217a93e9314e4b06ae49a36a9969e22e. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:13:17.642515 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:13:17.645475 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:13:17.769868 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-49f2a271-d0e6-4b34-9aa7-d855a4034c79 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.642199 Jun 06 13:13:17.770519 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 340/655] 10.222.0.13 () {62 vars in 1187 bytes} [Mon Jun 6 13:13:17 2022] POST /compute/v2.1/servers => generated 401 bytes in 643 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Jun 06 13:13:17.780546 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-49ea7af7-66a5-4b84-be0e-513d3973f0d5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:17.781151 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-49ea7af7-66a5-4b84-be0e-513d3973f0d5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:17.784816 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:INSERT=4,nova_api:SELECT=79,nova_api:UPDATE=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:17.842017 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-49ea7af7-66a5-4b84-be0e-513d3973f0d5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:17.849306 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-49ea7af7-66a5-4b84-be0e-513d3973f0d5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:17.851772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-49ea7af7-66a5-4b84-be0e-513d3973f0d5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:17.851954 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-49ea7af7-66a5-4b84-be0e-513d3973f0d5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1281 microversion: 2.20 time: 0.075272 Jun 06 13:13:17.852685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 316/656] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:17 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1281 bytes in 76 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:18.870894 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-87e237f6-7c24-427e-8875-79040a487b95 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:18.871724 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-87e237f6-7c24-427e-8875-79040a487b95 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:18.879264 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-87e237f6-7c24-427e-8875-79040a487b95 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:18.879759 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-87e237f6-7c24-427e-8875-79040a487b95 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:18.880544 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-87e237f6-7c24-427e-8875-79040a487b95 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:18.880971 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-87e237f6-7c24-427e-8875-79040a487b95 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:18.942663 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-87e237f6-7c24-427e-8875-79040a487b95 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:18.950969 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-87e237f6-7c24-427e-8875-79040a487b95 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:18.952499 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-87e237f6-7c24-427e-8875-79040a487b95 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:18.953607 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-87e237f6-7c24-427e-8875-79040a487b95 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1285 microversion: 2.20 time: 0.087197 Jun 06 13:13:18.954161 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 341/657] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:18 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1285 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:19.972537 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-8c8cb5bc-1222-4a03-a524-e52991a9fa34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:19.973369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8c8cb5bc-1222-4a03-a524-e52991a9fa34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:19.980666 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8c8cb5bc-1222-4a03-a524-e52991a9fa34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:19.981187 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8c8cb5bc-1222-4a03-a524-e52991a9fa34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:19.982047 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8c8cb5bc-1222-4a03-a524-e52991a9fa34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:19.982548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8c8cb5bc-1222-4a03-a524-e52991a9fa34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:20.050353 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-8c8cb5bc-1222-4a03-a524-e52991a9fa34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:20.058479 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-8c8cb5bc-1222-4a03-a524-e52991a9fa34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:20.061124 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-8c8cb5bc-1222-4a03-a524-e52991a9fa34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:20.061508 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-8c8cb5bc-1222-4a03-a524-e52991a9fa34 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1351 microversion: 2.20 time: 0.092738 Jun 06 13:13:20.061710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 317/658] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:19 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1351 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:21.079852 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-47a2fdb4-a65a-4e9e-b091-0788a57ee4b1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:21.080383 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-47a2fdb4-a65a-4e9e-b091-0788a57ee4b1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:21.088017 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47a2fdb4-a65a-4e9e-b091-0788a57ee4b1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:21.088471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47a2fdb4-a65a-4e9e-b091-0788a57ee4b1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:21.089538 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47a2fdb4-a65a-4e9e-b091-0788a57ee4b1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:21.089902 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47a2fdb4-a65a-4e9e-b091-0788a57ee4b1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:21.336803 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-47a2fdb4-a65a-4e9e-b091-0788a57ee4b1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:21.345568 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-47a2fdb4-a65a-4e9e-b091-0788a57ee4b1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:21.347099 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-47a2fdb4-a65a-4e9e-b091-0788a57ee4b1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:21.348300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-47a2fdb4-a65a-4e9e-b091-0788a57ee4b1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1406 microversion: 2.20 time: 0.272629 Jun 06 13:13:21.348891 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 342/659] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:21 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1406 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:21.829265 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-d0f92167-d2e5-44f8-9c00-fcf4316fca1f req-2fc74fac-7d30-42d8-8418-5601d5d0896c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e", "tag": "ec8a25f8-dea4-4bfd-9075-104851367737"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:21.839408 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-d0f92167-d2e5-44f8-9c00-fcf4316fca1f req-2fc74fac-7d30-42d8-8418-5601d5d0896c service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:21.840060 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-d0f92167-d2e5-44f8-9c00-fcf4316fca1f req-2fc74fac-7d30-42d8-8418-5601d5d0896c service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:21.854760 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-d0f92167-d2e5-44f8-9c00-fcf4316fca1f req-2fc74fac-7d30-42d8-8418-5601d5d0896c service nova] Creating event network-changed:ec8a25f8-dea4-4bfd-9075-104851367737 for instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e on hv-cinder-75510 Jun 06 13:13:21.859502 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-d0f92167-d2e5-44f8-9c00-fcf4316fca1f req-2fc74fac-7d30-42d8-8418-5601d5d0896c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034479 Jun 06 13:13:21.860140 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 318/660] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:13:21 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:22.366432 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-49361cc8-f447-4ca4-9759-83d2b2134009 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:22.367041 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-49361cc8-f447-4ca4-9759-83d2b2134009 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:22.373487 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49361cc8-f447-4ca4-9759-83d2b2134009 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:22.373935 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49361cc8-f447-4ca4-9759-83d2b2134009 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:22.374697 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49361cc8-f447-4ca4-9759-83d2b2134009 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:22.375164 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49361cc8-f447-4ca4-9759-83d2b2134009 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:22.509209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-49361cc8-f447-4ca4-9759-83d2b2134009 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:22.517286 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-49361cc8-f447-4ca4-9759-83d2b2134009 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:22.519327 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-49361cc8-f447-4ca4-9759-83d2b2134009 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:22.520464 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-49361cc8-f447-4ca4-9759-83d2b2134009 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1406 microversion: 2.20 time: 0.158190 Jun 06 13:13:22.521016 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 343/661] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:22 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1406 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:23.540364 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bc29fccd-5bf7-47bd-aa1b-f3539888f5d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:23.540970 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-bc29fccd-5bf7-47bd-aa1b-f3539888f5d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:23.547170 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bc29fccd-5bf7-47bd-aa1b-f3539888f5d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:23.547657 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bc29fccd-5bf7-47bd-aa1b-f3539888f5d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:23.548448 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bc29fccd-5bf7-47bd-aa1b-f3539888f5d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:23.548880 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bc29fccd-5bf7-47bd-aa1b-f3539888f5d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:23.730590 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-bc29fccd-5bf7-47bd-aa1b-f3539888f5d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:23.733063 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:23.740025 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-bc29fccd-5bf7-47bd-aa1b-f3539888f5d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:23.741597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-bc29fccd-5bf7-47bd-aa1b-f3539888f5d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:23.742778 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-bc29fccd-5bf7-47bd-aa1b-f3539888f5d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1406 microversion: 2.20 time: 0.207506 Jun 06 13:13:23.743358 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 319/662] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:23 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1406 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:24.766169 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c5b5996c-a503-424e-9853-e907a2f7199c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:24.766784 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c5b5996c-a503-424e-9853-e907a2f7199c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:24.773910 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c5b5996c-a503-424e-9853-e907a2f7199c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:24.774366 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c5b5996c-a503-424e-9853-e907a2f7199c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:24.775124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c5b5996c-a503-424e-9853-e907a2f7199c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:24.775580 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c5b5996c-a503-424e-9853-e907a2f7199c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:24.913083 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c5b5996c-a503-424e-9853-e907a2f7199c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:24.921898 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c5b5996c-a503-424e-9853-e907a2f7199c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:24.923700 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c5b5996c-a503-424e-9853-e907a2f7199c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:24.929157 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c5b5996c-a503-424e-9853-e907a2f7199c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1406 microversion: 2.20 time: 0.162996 Jun 06 13:13:24.929157 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 344/663] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:24 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1406 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:13:25.942977 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-7b83b635-799d-45a8-9d81-b8c779afbbe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:25.943599 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-7b83b635-799d-45a8-9d81-b8c779afbbe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:25.950597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b83b635-799d-45a8-9d81-b8c779afbbe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:25.951089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b83b635-799d-45a8-9d81-b8c779afbbe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:25.951990 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b83b635-799d-45a8-9d81-b8c779afbbe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:25.952425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b83b635-799d-45a8-9d81-b8c779afbbe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:26.087004 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-7b83b635-799d-45a8-9d81-b8c779afbbe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:26.094873 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-7b83b635-799d-45a8-9d81-b8c779afbbe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:26.096402 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-7b83b635-799d-45a8-9d81-b8c779afbbe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:26.098210 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-7b83b635-799d-45a8-9d81-b8c779afbbe2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1406 microversion: 2.20 time: 0.159574 Jun 06 13:13:26.098761 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 320/664] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:25 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1406 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:27.118621 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d77bbf78-4666-4cb9-9a65-abb38b07f506 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:27.119714 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d77bbf78-4666-4cb9-9a65-abb38b07f506 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:27.127198 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d77bbf78-4666-4cb9-9a65-abb38b07f506 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:27.127696 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d77bbf78-4666-4cb9-9a65-abb38b07f506 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:27.128907 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d77bbf78-4666-4cb9-9a65-abb38b07f506 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:27.129351 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d77bbf78-4666-4cb9-9a65-abb38b07f506 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:27.263456 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d77bbf78-4666-4cb9-9a65-abb38b07f506 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:27.271503 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d77bbf78-4666-4cb9-9a65-abb38b07f506 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:27.273026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d77bbf78-4666-4cb9-9a65-abb38b07f506 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:27.274129 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d77bbf78-4666-4cb9-9a65-abb38b07f506 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1406 microversion: 2.20 time: 0.162107 Jun 06 13:13:27.274680 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 345/665] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:27 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1406 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:28.292737 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-188d8af5-6aeb-47cd-aa39-06ccfaccc3dd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:28.293398 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-188d8af5-6aeb-47cd-aa39-06ccfaccc3dd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:28.295831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=6 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:28.301393 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-188d8af5-6aeb-47cd-aa39-06ccfaccc3dd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:28.301839 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-188d8af5-6aeb-47cd-aa39-06ccfaccc3dd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:28.302619 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-188d8af5-6aeb-47cd-aa39-06ccfaccc3dd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:28.303049 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-188d8af5-6aeb-47cd-aa39-06ccfaccc3dd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:28.433279 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-188d8af5-6aeb-47cd-aa39-06ccfaccc3dd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:28.441752 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-188d8af5-6aeb-47cd-aa39-06ccfaccc3dd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:28.443249 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-188d8af5-6aeb-47cd-aa39-06ccfaccc3dd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:28.444387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-188d8af5-6aeb-47cd-aa39-06ccfaccc3dd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1406 microversion: 2.20 time: 0.155606 Jun 06 13:13:28.444938 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 321/666] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:28 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1406 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:29.462326 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-af1c58d1-14e3-4b99-ad6f-5d15d12dc3c1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:29.462938 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-af1c58d1-14e3-4b99-ad6f-5d15d12dc3c1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:29.464813 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:29.465480 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:29.470817 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af1c58d1-14e3-4b99-ad6f-5d15d12dc3c1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:29.471271 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af1c58d1-14e3-4b99-ad6f-5d15d12dc3c1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:29.472110 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af1c58d1-14e3-4b99-ad6f-5d15d12dc3c1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:29.473045 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af1c58d1-14e3-4b99-ad6f-5d15d12dc3c1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:29.600455 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-af1c58d1-14e3-4b99-ad6f-5d15d12dc3c1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:29.608481 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-af1c58d1-14e3-4b99-ad6f-5d15d12dc3c1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:29.610033 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-af1c58d1-14e3-4b99-ad6f-5d15d12dc3c1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:29.611162 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-af1c58d1-14e3-4b99-ad6f-5d15d12dc3c1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1406 microversion: 2.20 time: 0.153003 Jun 06 13:13:29.611735 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 346/667] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:29 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1406 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:30.180752 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-0b47ea37-56da-4af1-8bf2-6d1e7f552043 req-23a480a5-5e7d-4575-b2be-745e8b627f71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e", "name": "network-vif-plugged", "status": "completed", "tag": "ec8a25f8-dea4-4bfd-9075-104851367737"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:30.189228 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-0b47ea37-56da-4af1-8bf2-6d1e7f552043 req-23a480a5-5e7d-4575-b2be-745e8b627f71 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:30.189661 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-0b47ea37-56da-4af1-8bf2-6d1e7f552043 req-23a480a5-5e7d-4575-b2be-745e8b627f71 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:30.200771 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-0b47ea37-56da-4af1-8bf2-6d1e7f552043 req-23a480a5-5e7d-4575-b2be-745e8b627f71 service nova] Creating event network-vif-plugged:ec8a25f8-dea4-4bfd-9075-104851367737 for instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e on hv-cinder-75510 Jun 06 13:13:30.205487 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-0b47ea37-56da-4af1-8bf2-6d1e7f552043 req-23a480a5-5e7d-4575-b2be-745e8b627f71 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028665 Jun 06 13:13:30.206056 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 322/668] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:13:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:30.630190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e6c2f748-1031-4d3e-9dd8-b047347c6b7b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:30.630841 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e6c2f748-1031-4d3e-9dd8-b047347c6b7b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:30.637377 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e6c2f748-1031-4d3e-9dd8-b047347c6b7b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:30.637872 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e6c2f748-1031-4d3e-9dd8-b047347c6b7b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:30.638636 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e6c2f748-1031-4d3e-9dd8-b047347c6b7b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:30.639073 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e6c2f748-1031-4d3e-9dd8-b047347c6b7b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:30.662401 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-04f0c330-bb37-4c6c-9125-5f10f549c206 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:30.664145 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-04f0c330-bb37-4c6c-9125-5f10f549c206 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:30.670426 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04f0c330-bb37-4c6c-9125-5f10f549c206 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:30.670923 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04f0c330-bb37-4c6c-9125-5f10f549c206 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:30.671671 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04f0c330-bb37-4c6c-9125-5f10f549c206 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:30.672152 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-04f0c330-bb37-4c6c-9125-5f10f549c206 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:30.774296 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e6c2f748-1031-4d3e-9dd8-b047347c6b7b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:30.782042 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e6c2f748-1031-4d3e-9dd8-b047347c6b7b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:30.783558 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e6c2f748-1031-4d3e-9dd8-b047347c6b7b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:30.784648 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e6c2f748-1031-4d3e-9dd8-b047347c6b7b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1406 microversion: 2.20 time: 0.158773 Jun 06 13:13:30.785197 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 347/669] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:30 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1406 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:30.839931 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-04f0c330-bb37-4c6c-9125-5f10f549c206 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "POST /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/action" status: 202 len: 0 microversion: 2.1 time: 0.182307 Jun 06 13:13:30.844286 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 323/670] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:13:30 2022] POST /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/action => generated 0 bytes in 184 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 13:13:30.848589 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e26d4445-39cf-4d32-aebd-2253242ffc1b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:30.849188 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e26d4445-39cf-4d32-aebd-2253242ffc1b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:30.855183 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e26d4445-39cf-4d32-aebd-2253242ffc1b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:30.855656 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e26d4445-39cf-4d32-aebd-2253242ffc1b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:30.856420 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e26d4445-39cf-4d32-aebd-2253242ffc1b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:30.856847 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e26d4445-39cf-4d32-aebd-2253242ffc1b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:31.000600 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e26d4445-39cf-4d32-aebd-2253242ffc1b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:31.009702 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e26d4445-39cf-4d32-aebd-2253242ffc1b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1748 microversion: 2.1 time: 0.164839 Jun 06 13:13:31.010280 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 348/671] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:30 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1748 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:31.806082 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0720b5d5-537e-4aa1-acc4-12109df1e785 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:31.807960 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0720b5d5-537e-4aa1-acc4-12109df1e785 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:31.814487 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0720b5d5-537e-4aa1-acc4-12109df1e785 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:31.815025 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0720b5d5-537e-4aa1-acc4-12109df1e785 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:31.815823 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0720b5d5-537e-4aa1-acc4-12109df1e785 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:31.816261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0720b5d5-537e-4aa1-acc4-12109df1e785 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:32.027289 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b092d36b-2adc-4e89-b044-f9a19297e587 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:32.027930 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b092d36b-2adc-4e89-b044-f9a19297e587 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:32.034439 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b092d36b-2adc-4e89-b044-f9a19297e587 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:32.034888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b092d36b-2adc-4e89-b044-f9a19297e587 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:32.036235 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b092d36b-2adc-4e89-b044-f9a19297e587 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:32.036939 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b092d36b-2adc-4e89-b044-f9a19297e587 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:32.156038 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-0720b5d5-537e-4aa1-acc4-12109df1e785 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:32.165912 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-0720b5d5-537e-4aa1-acc4-12109df1e785 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:32.167420 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-0720b5d5-537e-4aa1-acc4-12109df1e785 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:32.168573 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0720b5d5-537e-4aa1-acc4-12109df1e785 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1406 microversion: 2.20 time: 0.368678 Jun 06 13:13:32.169137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 324/672] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:31 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1406 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:13:32.212893 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b092d36b-2adc-4e89-b044-f9a19297e587 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:32.220937 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b092d36b-2adc-4e89-b044-f9a19297e587 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1748 microversion: 2.1 time: 0.197585 Jun 06 13:13:32.221507 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 349/673] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:32 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1748 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:13:33.187815 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-50854dcb-cb9c-45c0-80c5-c358b91211d7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:33.188423 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-50854dcb-cb9c-45c0-80c5-c358b91211d7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:33.195314 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-50854dcb-cb9c-45c0-80c5-c358b91211d7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:33.195796 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-50854dcb-cb9c-45c0-80c5-c358b91211d7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:33.196555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-50854dcb-cb9c-45c0-80c5-c358b91211d7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:33.197153 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-50854dcb-cb9c-45c0-80c5-c358b91211d7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:33.238358 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-05f01a49-b60c-4974-afe4-479afb116b69 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:33.239010 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-05f01a49-b60c-4974-afe4-479afb116b69 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:33.246119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-05f01a49-b60c-4974-afe4-479afb116b69 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:33.246563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-05f01a49-b60c-4974-afe4-479afb116b69 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:33.247461 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-05f01a49-b60c-4974-afe4-479afb116b69 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:33.247924 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-05f01a49-b60c-4974-afe4-479afb116b69 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:33.380612 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-50854dcb-cb9c-45c0-80c5-c358b91211d7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:33.388919 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-50854dcb-cb9c-45c0-80c5-c358b91211d7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:33.390425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-50854dcb-cb9c-45c0-80c5-c358b91211d7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:33.391601 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-50854dcb-cb9c-45c0-80c5-c358b91211d7 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1598 microversion: 2.20 time: 0.208452 Jun 06 13:13:33.392153 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 325/674] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:13:33 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1598 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:13:33.410772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-17310ab8-6f89-4945-bfeb-53221f068d8a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:33.412561 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-17310ab8-6f89-4945-bfeb-53221f068d8a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:33.419417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-17310ab8-6f89-4945-bfeb-53221f068d8a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:33.419828 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-17310ab8-6f89-4945-bfeb-53221f068d8a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:33.420653 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-17310ab8-6f89-4945-bfeb-53221f068d8a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:33.421085 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-17310ab8-6f89-4945-bfeb-53221f068d8a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:33.424975 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-05f01a49-b60c-4974-afe4-479afb116b69 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:33.433487 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-05f01a49-b60c-4974-afe4-479afb116b69 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1753 microversion: 2.1 time: 0.199070 Jun 06 13:13:33.434066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 350/675] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:33 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1753 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:13:33.500990 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-17310ab8-6f89-4945-bfeb-53221f068d8a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.094382 Jun 06 13:13:33.501578 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 326/676] 10.222.0.13 () {60 vars in 1315 bytes} [Mon Jun 6 13:13:33 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/os-interface => generated 284 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Jun 06 13:13:34.450581 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1884c182-cf29-4b3c-b050-a2810446cc2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:34.451206 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1884c182-cf29-4b3c-b050-a2810446cc2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:34.457976 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1884c182-cf29-4b3c-b050-a2810446cc2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:34.458432 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1884c182-cf29-4b3c-b050-a2810446cc2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:34.459228 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1884c182-cf29-4b3c-b050-a2810446cc2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:34.459691 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1884c182-cf29-4b3c-b050-a2810446cc2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:34.775199 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-5488f14f-6d66-4981-80c4-e32316ddbab9 req-396f8bc7-e7c0-4961-830c-5a4e03f4f010 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e", "tag": "ec8a25f8-dea4-4bfd-9075-104851367737"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:34.784435 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-5488f14f-6d66-4981-80c4-e32316ddbab9 req-396f8bc7-e7c0-4961-830c-5a4e03f4f010 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:34.784995 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-5488f14f-6d66-4981-80c4-e32316ddbab9 req-396f8bc7-e7c0-4961-830c-5a4e03f4f010 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:34.797817 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-5488f14f-6d66-4981-80c4-e32316ddbab9 req-396f8bc7-e7c0-4961-830c-5a4e03f4f010 service nova] Creating event network-changed:ec8a25f8-dea4-4bfd-9075-104851367737 for instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e on hv-cinder-75510 Jun 06 13:13:34.801088 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1884c182-cf29-4b3c-b050-a2810446cc2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:34.804099 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-5488f14f-6d66-4981-80c4-e32316ddbab9 req-396f8bc7-e7c0-4961-830c-5a4e03f4f010 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034471 Jun 06 13:13:34.804922 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 327/677] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:13:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:34.811992 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1884c182-cf29-4b3c-b050-a2810446cc2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1753 microversion: 2.1 time: 0.365510 Jun 06 13:13:34.812621 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 351/678] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:34 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1753 bytes in 367 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:35.830623 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0a0b301a-dad4-481c-8e6f-d465ea51bdc2 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:35.831225 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0a0b301a-dad4-481c-8e6f-d465ea51bdc2 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:35.837562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0a0b301a-dad4-481c-8e6f-d465ea51bdc2 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:35.838005 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0a0b301a-dad4-481c-8e6f-d465ea51bdc2 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:35.838758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0a0b301a-dad4-481c-8e6f-d465ea51bdc2 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:35.839185 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0a0b301a-dad4-481c-8e6f-d465ea51bdc2 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:36.030289 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-0a0b301a-dad4-481c-8e6f-d465ea51bdc2 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:36.039263 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0a0b301a-dad4-481c-8e6f-d465ea51bdc2 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1753 microversion: 2.1 time: 0.213607 Jun 06 13:13:36.039847 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 328/679] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:35 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1753 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:37.056025 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8cd4154e-2647-4058-a624-9bd7a2cb0988 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:37.056630 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8cd4154e-2647-4058-a624-9bd7a2cb0988 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:37.062612 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8cd4154e-2647-4058-a624-9bd7a2cb0988 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:37.063052 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8cd4154e-2647-4058-a624-9bd7a2cb0988 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:37.063827 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8cd4154e-2647-4058-a624-9bd7a2cb0988 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:37.064260 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8cd4154e-2647-4058-a624-9bd7a2cb0988 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:37.207645 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8cd4154e-2647-4058-a624-9bd7a2cb0988 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:37.215917 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8cd4154e-2647-4058-a624-9bd7a2cb0988 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1753 microversion: 2.1 time: 0.164062 Jun 06 13:13:37.216529 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 352/680] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:37 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1753 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:37.764526 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0761126a-558f-4495-8193-9882c908bcb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:37.765512 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0761126a-558f-4495-8193-9882c908bcb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:37.772522 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0761126a-558f-4495-8193-9882c908bcb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:37.772965 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0761126a-558f-4495-8193-9882c908bcb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:37.773727 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0761126a-558f-4495-8193-9882c908bcb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:37.774167 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0761126a-558f-4495-8193-9882c908bcb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:37.804316 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0761126a-558f-4495-8193-9882c908bcb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.043685 Jun 06 13:13:37.804860 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 329/681] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:13:37 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 13:13:37.861828 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e1d9ef03-e5e5-4d94-a760-c4c059209dd6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:37.862315 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e1d9ef03-e5e5-4d94-a760-c4c059209dd6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:37.868924 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e1d9ef03-e5e5-4d94-a760-c4c059209dd6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:37.869365 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e1d9ef03-e5e5-4d94-a760-c4c059209dd6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:37.870115 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e1d9ef03-e5e5-4d94-a760-c4c059209dd6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:37.870545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e1d9ef03-e5e5-4d94-a760-c4c059209dd6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:37.894831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e1d9ef03-e5e5-4d94-a760-c4c059209dd6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:13:37.898435 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:38.179158 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e1d9ef03-e5e5-4d94-a760-c4c059209dd6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 204 len: 0 microversion: 2.1 time: 0.320921 Jun 06 13:13:38.180689 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 353/682] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:13:37 2022] DELETE /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:13:38.188262 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9ca1c8ab-44b7-4fb5-8ff0-1fe33dad9193 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:38.190150 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9ca1c8ab-44b7-4fb5-8ff0-1fe33dad9193 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:38.196043 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9ca1c8ab-44b7-4fb5-8ff0-1fe33dad9193 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:38.196492 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9ca1c8ab-44b7-4fb5-8ff0-1fe33dad9193 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:38.197256 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9ca1c8ab-44b7-4fb5-8ff0-1fe33dad9193 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:38.197692 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9ca1c8ab-44b7-4fb5-8ff0-1fe33dad9193 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:38.233837 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-86c58bae-bd95-4fb5-a1c1-79d4b639fefb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:38.234535 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-86c58bae-bd95-4fb5-a1c1-79d4b639fefb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:38.241791 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-86c58bae-bd95-4fb5-a1c1-79d4b639fefb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:38.247417 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-86c58bae-bd95-4fb5-a1c1-79d4b639fefb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:38.247417 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-86c58bae-bd95-4fb5-a1c1-79d4b639fefb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:38.247417 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-86c58bae-bd95-4fb5-a1c1-79d4b639fefb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:38.381908 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9ca1c8ab-44b7-4fb5-8ff0-1fe33dad9193 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:38.389799 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9ca1c8ab-44b7-4fb5-8ff0-1fe33dad9193 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1675 microversion: 2.1 time: 0.205352 Jun 06 13:13:38.390743 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 330/683] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:38 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1675 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:38.424331 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-86c58bae-bd95-4fb5-a1c1-79d4b639fefb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:38.433064 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-86c58bae-bd95-4fb5-a1c1-79d4b639fefb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1753 microversion: 2.1 time: 0.203373 Jun 06 13:13:38.433578 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 354/684] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:38 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1753 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:13:39.406260 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a3d70dc1-6027-4755-93e9-02610a66cbeb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:39.406903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a3d70dc1-6027-4755-93e9-02610a66cbeb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:39.414577 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a3d70dc1-6027-4755-93e9-02610a66cbeb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:39.415016 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a3d70dc1-6027-4755-93e9-02610a66cbeb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:39.415808 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a3d70dc1-6027-4755-93e9-02610a66cbeb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:39.416246 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a3d70dc1-6027-4755-93e9-02610a66cbeb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:39.448999 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a5edc381-cb82-4890-9571-6970a491deeb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:39.449601 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a5edc381-cb82-4890-9571-6970a491deeb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:39.456364 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a5edc381-cb82-4890-9571-6970a491deeb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:39.456803 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a5edc381-cb82-4890-9571-6970a491deeb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:39.457557 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a5edc381-cb82-4890-9571-6970a491deeb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:39.457984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a5edc381-cb82-4890-9571-6970a491deeb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:39.651989 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a3d70dc1-6027-4755-93e9-02610a66cbeb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:39.659669 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a3d70dc1-6027-4755-93e9-02610a66cbeb tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1675 microversion: 2.1 time: 0.257206 Jun 06 13:13:39.660240 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 331/685] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:39 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1675 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:39.687227 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a5edc381-cb82-4890-9571-6970a491deeb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:39.695607 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a5edc381-cb82-4890-9571-6970a491deeb tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1753 microversion: 2.1 time: 0.250295 Jun 06 13:13:39.696186 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 355/686] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:39 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1753 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:13:40.680138 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c9fe22bc-4d40-4bec-a5d3-122115c3fa09 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:40.692079 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c9fe22bc-4d40-4bec-a5d3-122115c3fa09 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:40.705442 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c9fe22bc-4d40-4bec-a5d3-122115c3fa09 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:40.706226 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c9fe22bc-4d40-4bec-a5d3-122115c3fa09 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:40.715857 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a343cc38-7479-4656-bd90-dc5a0c646718 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:40.716540 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a343cc38-7479-4656-bd90-dc5a0c646718 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:40.725586 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a343cc38-7479-4656-bd90-dc5a0c646718 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:40.725586 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a343cc38-7479-4656-bd90-dc5a0c646718 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:40.726044 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a343cc38-7479-4656-bd90-dc5a0c646718 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:40.726477 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a343cc38-7479-4656-bd90-dc5a0c646718 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:40.730311 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c9fe22bc-4d40-4bec-a5d3-122115c3fa09 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:40.730979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c9fe22bc-4d40-4bec-a5d3-122115c3fa09 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.023s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:40.954713 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c9fe22bc-4d40-4bec-a5d3-122115c3fa09 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:40.966689 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c9fe22bc-4d40-4bec-a5d3-122115c3fa09 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1675 microversion: 2.1 time: 0.292257 Jun 06 13:13:40.970211 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a343cc38-7479-4656-bd90-dc5a0c646718 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:40.976941 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 332/687] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:40 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1675 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:40.980188 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a343cc38-7479-4656-bd90-dc5a0c646718 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1753 microversion: 2.1 time: 0.269030 Jun 06 13:13:40.981576 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 356/688] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:40 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1753 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:41.457214 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-0ae8f727-5f8e-479c-900a-abf9b3957f73 req-80ec5977-9058-4893-bcb6-1f169ba925b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "05c0144f-361b-4c15-813d-6c7b190ff600", "name": "network-vif-deleted", "tag": "39a2bbdc-cbb4-47cf-8e60-ceacd2a33a82"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:41.466092 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-0ae8f727-5f8e-479c-900a-abf9b3957f73 req-80ec5977-9058-4893-bcb6-1f169ba925b8 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:41.466533 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-0ae8f727-5f8e-479c-900a-abf9b3957f73 req-80ec5977-9058-4893-bcb6-1f169ba925b8 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:41.483974 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-0ae8f727-5f8e-479c-900a-abf9b3957f73 req-80ec5977-9058-4893-bcb6-1f169ba925b8 service nova] Creating event network-vif-deleted:39a2bbdc-cbb4-47cf-8e60-ceacd2a33a82 for instance 05c0144f-361b-4c15-813d-6c7b190ff600 on hv-cinder-75510 Jun 06 13:13:41.483974 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-0ae8f727-5f8e-479c-900a-abf9b3957f73 req-80ec5977-9058-4893-bcb6-1f169ba925b8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030091 Jun 06 13:13:41.484429 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 333/689] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:13:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:41.988494 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a3041ce0-d01e-42c0-af89-0c3d89e43398 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:41.989107 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a3041ce0-d01e-42c0-af89-0c3d89e43398 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:41.996661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3041ce0-d01e-42c0-af89-0c3d89e43398 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:41.997112 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3041ce0-d01e-42c0-af89-0c3d89e43398 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:42.000244 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3041ce0-d01e-42c0-af89-0c3d89e43398 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:42.000244 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3041ce0-d01e-42c0-af89-0c3d89e43398 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:42.002850 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f3b5c57f-7663-40d5-8158-181eac219c19 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:42.003579 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f3b5c57f-7663-40d5-8158-181eac219c19 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:42.011141 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f3b5c57f-7663-40d5-8158-181eac219c19 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:42.011616 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f3b5c57f-7663-40d5-8158-181eac219c19 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:42.012600 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f3b5c57f-7663-40d5-8158-181eac219c19 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:42.013031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f3b5c57f-7663-40d5-8158-181eac219c19 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:42.034672 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3041ce0-d01e-42c0-af89-0c3d89e43398 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:42.034672 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a3041ce0-d01e-42c0-af89-0c3d89e43398 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:42.034672 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-a3041ce0-d01e-42c0-af89-0c3d89e43398 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lazy-loading 'fault' on Instance uuid 05c0144f-361b-4c15-813d-6c7b190ff600 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:13:42.088124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a3041ce0-d01e-42c0-af89-0c3d89e43398 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:42.102393 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a3041ce0-d01e-42c0-af89-0c3d89e43398 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 200 len: 1328 microversion: 2.1 time: 0.117726 Jun 06 13:13:42.107947 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 357/690] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:41 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 1328 bytes in 124 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:42.201581 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f3b5c57f-7663-40d5-8158-181eac219c19 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:42.209903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f3b5c57f-7663-40d5-8158-181eac219c19 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1753 microversion: 2.1 time: 0.211106 Jun 06 13:13:42.219769 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 334/691] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:41 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1753 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:43.120313 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-386d1831-f0b9-4f9a-b634-aa55cc746131 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:43.120929 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-386d1831-f0b9-4f9a-b634-aa55cc746131 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:43.127647 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-386d1831-f0b9-4f9a-b634-aa55cc746131 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:43.128096 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-386d1831-f0b9-4f9a-b634-aa55cc746131 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:43.128861 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-386d1831-f0b9-4f9a-b634-aa55cc746131 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:43.129342 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-386d1831-f0b9-4f9a-b634-aa55cc746131 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:43.143427 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-386d1831-f0b9-4f9a-b634-aa55cc746131 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] HTTP exception thrown: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-386d1831-f0b9-4f9a-b634-aa55cc746131 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Request method failure captured: Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 HTTP/1.1 Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxbTNndWrSTGdcCk2Zy0fCQdJIvkGnzW92hqqjvYLTdjslmnrOVe54bpoAtzcdHg9dcoTC05j8bt1azp98k1P01zAsB0TULfuqhMcSXNzh6C-_uzTO-7MyNHNSCkLhqbWGcsLUb0aHSUi5pzziJw1W1_gx5YajMqdnK-lmwN0HcyWY Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: 2b88389a00a342e285e0c31b90368f87 Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:13:43.145124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:13:43.147608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2b88389a00a342e285e0c31b90368f87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b88389a00a342e285e0c31b90368f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b88389a00a342e285e0c31b90368f87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2b88389a00a342e285e0c31b90368f87"}]}] Jun 06 13:13:43.147608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:13:43.147608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 2b88389a00a342e285e0c31b90368f87 Jun 06 13:13:43.147608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:13:43.147608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeTestJSON-1237312882-project Jun 06 13:13:43.147608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:13:43.147608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:13:43.147608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 288ab671062d409f98b91aeacde8b5fc Jun 06 13:13:43.147608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeTestJSON-1237312882-project Jun 06 13:13:43.147608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:13:43.147608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:13:43.147608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': '05c0144f-361b-4c15-813d-6c7b190ff600'} Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:13:43.148545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:13:43.150542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:13:43.151868 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-386d1831-f0b9-4f9a-b634-aa55cc746131 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Returning 404 to user: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:13:43.151868 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-386d1831-f0b9-4f9a-b634-aa55cc746131 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 404 len: 111 microversion: 2.1 time: 0.030843 Jun 06 13:13:43.151868 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 358/692] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:43 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:13:43.157010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c3fcfb30-6c4b-463c-bbf2-4c9f4280a6d0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '.version_select at 0x7f0efc0c3ee0>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:43.216975 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c3fcfb30-6c4b-463c-bbf2-4c9f4280a6d0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193851189" status: 202 len: 0 microversion: 2.1 time: 0.060473 Jun 06 13:13:43.217838 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 335/693] 10.222.0.13 () {58 vars in 1220 bytes} [Mon Jun 6 13:13:43 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1193851189 => generated 0 bytes in 66 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:13:43.226155 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-eaee28f2-60e5-4e72-8424-161ffa6bda29 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:43.226808 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-eaee28f2-60e5-4e72-8424-161ffa6bda29 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:43.233154 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eaee28f2-60e5-4e72-8424-161ffa6bda29 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:43.233601 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eaee28f2-60e5-4e72-8424-161ffa6bda29 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:43.234377 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eaee28f2-60e5-4e72-8424-161ffa6bda29 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:43.235009 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eaee28f2-60e5-4e72-8424-161ffa6bda29 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:43.404416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-eaee28f2-60e5-4e72-8424-161ffa6bda29 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:43.413319 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-eaee28f2-60e5-4e72-8424-161ffa6bda29 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1753 microversion: 2.1 time: 0.190945 Jun 06 13:13:43.414661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 359/694] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:43 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1753 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:43.961486 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-38997605-ad4c-49eb-aa4e-85cf9184ce2d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:43.961982 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-38997605-ad4c-49eb-aa4e-85cf9184ce2d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:43.968153 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38997605-ad4c-49eb-aa4e-85cf9184ce2d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:43.968606 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38997605-ad4c-49eb-aa4e-85cf9184ce2d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:43.969395 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38997605-ad4c-49eb-aa4e-85cf9184ce2d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:43.969867 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38997605-ad4c-49eb-aa4e-85cf9184ce2d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:44.084332 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-38997605-ad4c-49eb-aa4e-85cf9184ce2d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lazy-loading 'services' on Instance uuid a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:13:44.356756 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-38997605-ad4c-49eb-aa4e-85cf9184ce2d tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-volume_attachments/d20211b5-66ff-4f7d-855d-18cabdcbc58e" status: 202 len: 0 microversion: 2.1 time: 0.399435 Jun 06 13:13:44.362181 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 336/695] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 13:13:43 2022] DELETE /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-volume_attachments/d20211b5-66ff-4f7d-855d-18cabdcbc58e => generated 0 bytes in 406 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:13:44.370221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-53f23cc6-e0a7-4ec6-8eea-e456b6693c99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:44.371915 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-53f23cc6-e0a7-4ec6-8eea-e456b6693c99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:44.382210 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-53f23cc6-e0a7-4ec6-8eea-e456b6693c99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:44.382700 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-53f23cc6-e0a7-4ec6-8eea-e456b6693c99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:44.383771 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-53f23cc6-e0a7-4ec6-8eea-e456b6693c99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:44.384220 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-53f23cc6-e0a7-4ec6-8eea-e456b6693c99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:44.402201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-aae1aba3-4dbc-49db-9f7a-ebe97b77b00e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Action: 'create', calling method: .version_select at 0x7f0efc4b03a0>, body: {"keypair": {"name": "tempest-keypair-715219307", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJuXUjO+b7+J56PCG01Wjd66JE6QYwzJM0jLbW/wZfWRS3dS9h9TIZoma1v33tlIIyo1tO4ufY6IOIWmyD4WuIf3T5oeOquCcdvifomP/m91qMMjPgImut5RKAXre6+7nQ=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:44.434842 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-aae1aba3-4dbc-49db-9f7a-ebe97b77b00e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Getting quotas for project 2b88389a00a342e285e0c31b90368f87. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:13:44.441309 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-aae1aba3-4dbc-49db-9f7a-ebe97b77b00e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Getting quotas for user 288ab671062d409f98b91aeacde8b5fc and project 2b88389a00a342e285e0c31b90368f87. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:13:44.458955 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-53f23cc6-e0a7-4ec6-8eea-e456b6693c99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.093679 Jun 06 13:13:44.459572 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 337/696] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:13:44 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-volume_attachments => generated 197 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:44.467392 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-709539cd-c4fb-4bb8-a2a4-d965e71e246f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:44.468421 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-709539cd-c4fb-4bb8-a2a4-d965e71e246f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:44.476034 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-709539cd-c4fb-4bb8-a2a4-d965e71e246f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:44.491555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-709539cd-c4fb-4bb8-a2a4-d965e71e246f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:44.491555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-709539cd-c4fb-4bb8-a2a4-d965e71e246f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:44.491555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-709539cd-c4fb-4bb8-a2a4-d965e71e246f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:44.494608 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:44.549462 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-aae1aba3-4dbc-49db-9f7a-ebe97b77b00e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.381204 Jun 06 13:13:44.551611 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 360/697] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 13:13:44 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:44.654769 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-709539cd-c4fb-4bb8-a2a4-d965e71e246f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:44.667858 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-709539cd-c4fb-4bb8-a2a4-d965e71e246f tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1753 microversion: 2.1 time: 0.206291 Jun 06 13:13:44.669959 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 338/698] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:44 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1753 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:45.470668 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f782421d-c11d-44fe-8c10-62bed8962b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:45.471912 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f782421d-c11d-44fe-8c10-62bed8962b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:45.487256 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f782421d-c11d-44fe-8c10-62bed8962b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:45.495004 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f782421d-c11d-44fe-8c10-62bed8962b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:45.496108 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f782421d-c11d-44fe-8c10-62bed8962b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:45.496792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f782421d-c11d-44fe-8c10-62bed8962b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:45.533862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f782421d-c11d-44fe-8c10-62bed8962b4e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.067347 Jun 06 13:13:45.534476 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 361/699] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:13:45 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-volume_attachments => generated 197 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:45.686262 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-77ea6ddf-167a-4e45-9f8b-d361d0d862e8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:45.686848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-77ea6ddf-167a-4e45-9f8b-d361d0d862e8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:45.695062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-77ea6ddf-167a-4e45-9f8b-d361d0d862e8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:45.695501 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-77ea6ddf-167a-4e45-9f8b-d361d0d862e8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:45.697784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-77ea6ddf-167a-4e45-9f8b-d361d0d862e8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:45.697784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-77ea6ddf-167a-4e45-9f8b-d361d0d862e8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:45.977188 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-77ea6ddf-167a-4e45-9f8b-d361d0d862e8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:45.990449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-77ea6ddf-167a-4e45-9f8b-d361d0d862e8 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1753 microversion: 2.1 time: 0.305557 Jun 06 13:13:45.991087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 339/700] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:45 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1753 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:46.546581 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1bd2c341-41e6-4bee-b2c1-7c73deeb0914 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:46.548386 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1bd2c341-41e6-4bee-b2c1-7c73deeb0914 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:46.557235 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1bd2c341-41e6-4bee-b2c1-7c73deeb0914 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:46.558407 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1bd2c341-41e6-4bee-b2c1-7c73deeb0914 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:46.560153 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1bd2c341-41e6-4bee-b2c1-7c73deeb0914 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:46.560903 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1bd2c341-41e6-4bee-b2c1-7c73deeb0914 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:46.613309 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1bd2c341-41e6-4bee-b2c1-7c73deeb0914 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.070749 Jun 06 13:13:46.614808 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 362/701] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:13:46 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed/os-volume_attachments => generated 25 bytes in 73 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 13:13:46.684594 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e862e4ac-f53d-4fde-bab3-7eb9011ed80a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:46.685086 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e862e4ac-f53d-4fde-bab3-7eb9011ed80a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:46.692260 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e862e4ac-f53d-4fde-bab3-7eb9011ed80a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:46.693389 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e862e4ac-f53d-4fde-bab3-7eb9011ed80a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:46.694289 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e862e4ac-f53d-4fde-bab3-7eb9011ed80a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:46.694654 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e862e4ac-f53d-4fde-bab3-7eb9011ed80a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:46.723087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e862e4ac-f53d-4fde-bab3-7eb9011ed80a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Going to try to terminate instance {{(pid=118134) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:13:47.006622 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e862e4ac-f53d-4fde-bab3-7eb9011ed80a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 204 len: 0 microversion: 2.1 time: 0.325928 Jun 06 13:13:47.009888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-54f1f8b6-bd8f-4fbf-8210-0e1e5d981d06 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:47.010499 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-54f1f8b6-bd8f-4fbf-8210-0e1e5d981d06 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:47.013760 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 340/702] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:13:46 2022] DELETE /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 0 bytes in 334 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:13:47.019464 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-54f1f8b6-bd8f-4fbf-8210-0e1e5d981d06 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:47.023337 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cfe94643-4bae-49b0-8fdb-77bed397cc96 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:47.024272 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-cfe94643-4bae-49b0-8fdb-77bed397cc96 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:47.025031 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-54f1f8b6-bd8f-4fbf-8210-0e1e5d981d06 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:47.026028 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-54f1f8b6-bd8f-4fbf-8210-0e1e5d981d06 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:47.026465 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-54f1f8b6-bd8f-4fbf-8210-0e1e5d981d06 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:47.044821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cfe94643-4bae-49b0-8fdb-77bed397cc96 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:47.045567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cfe94643-4bae-49b0-8fdb-77bed397cc96 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:47.046385 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cfe94643-4bae-49b0-8fdb-77bed397cc96 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:47.046872 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cfe94643-4bae-49b0-8fdb-77bed397cc96 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:47.334308 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-54f1f8b6-bd8f-4fbf-8210-0e1e5d981d06 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:47.345418 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-54f1f8b6-bd8f-4fbf-8210-0e1e5d981d06 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1756 microversion: 2.1 time: 0.340919 Jun 06 13:13:47.347006 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 363/703] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:47 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1756 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:47.379166 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cfe94643-4bae-49b0-8fdb-77bed397cc96 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:47.393855 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cfe94643-4bae-49b0-8fdb-77bed397cc96 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1689 microversion: 2.1 time: 0.376128 Jun 06 13:13:47.404081 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 341/704] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:47 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1689 bytes in 387 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:13:47.893422 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1408257175", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "8be75cc5-d338-4e12-b1d6-bd98dfb35b62"}], "security_groups": [{"name": "tempest-securitygroup--86154488"}], "key_name": "tempest-keypair-715219307", "user_data": "}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:47.901337 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=77,nova_api:INSERT=4,nova_api:UPDATE=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:48.320849 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] validate_networks() for [('8be75cc5-d338-4e12-b1d6-bd98dfb35b62', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:13:48.415762 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-71409b1c-a292-483e-8666-1e556fc84808 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:48.416929 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-71409b1c-a292-483e-8666-1e556fc84808 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:48.434336 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71409b1c-a292-483e-8666-1e556fc84808 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:48.435135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71409b1c-a292-483e-8666-1e556fc84808 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:48.436229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71409b1c-a292-483e-8666-1e556fc84808 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:48.437118 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71409b1c-a292-483e-8666-1e556fc84808 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:48.627252 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-71409b1c-a292-483e-8666-1e556fc84808 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:48.643857 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-71409b1c-a292-483e-8666-1e556fc84808 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1689 microversion: 2.1 time: 0.235214 Jun 06 13:13:48.644915 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 342/705] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:48 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1689 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:48.840351 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:13:48.840779 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:13:48.841256 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:13:48.841711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:13:48.842124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:13:48.854116 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:48.858991 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:48.858991 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:48.858991 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:48.881666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Getting quotas for project 2b88389a00a342e285e0c31b90368f87. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:13:48.886616 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Getting quotas for user 288ab671062d409f98b91aeacde8b5fc and project 2b88389a00a342e285e0c31b90368f87. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:13:48.898951 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:13:48.901287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:13:49.077457 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5d1ad0dc-74f6-48e3-9db3-5655be2082c3 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 400 microversion: 2.1 time: 1.188268 Jun 06 13:13:49.078272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 364/706] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:13:47 2022] POST /compute/v2.1/servers => generated 400 bytes in 1190 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:13:49.089245 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0b360f27-07a0-45cf-b62e-ac387faa3d6a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:49.090126 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0b360f27-07a0-45cf-b62e-ac387faa3d6a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:49.171134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-0b360f27-07a0-45cf-b62e-ac387faa3d6a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:49.180123 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0b360f27-07a0-45cf-b62e-ac387faa3d6a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1237 microversion: 2.1 time: 0.093072 Jun 06 13:13:49.187380 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 343/707] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:49 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1237 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:49.665689 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8835dcf7-883d-4d46-a089-a70eaa778659 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:49.668609 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8835dcf7-883d-4d46-a089-a70eaa778659 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:49.679654 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8835dcf7-883d-4d46-a089-a70eaa778659 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:49.680108 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8835dcf7-883d-4d46-a089-a70eaa778659 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:49.681151 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8835dcf7-883d-4d46-a089-a70eaa778659 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:49.681346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8835dcf7-883d-4d46-a089-a70eaa778659 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:49.841318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8835dcf7-883d-4d46-a089-a70eaa778659 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:49.852415 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8835dcf7-883d-4d46-a089-a70eaa778659 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1689 microversion: 2.1 time: 0.194096 Jun 06 13:13:49.853726 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 365/708] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:49 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1689 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:50.200343 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-8d280f6a-5388-4292-a9d7-4bca3b68a004 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:50.200961 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8d280f6a-5388-4292-a9d7-4bca3b68a004 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:50.212038 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8d280f6a-5388-4292-a9d7-4bca3b68a004 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:50.212038 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8d280f6a-5388-4292-a9d7-4bca3b68a004 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:50.212038 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8d280f6a-5388-4292-a9d7-4bca3b68a004 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:50.212038 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8d280f6a-5388-4292-a9d7-4bca3b68a004 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:50.301546 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-8d280f6a-5388-4292-a9d7-4bca3b68a004 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:50.305435 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-8d280f6a-5388-4292-a9d7-4bca3b68a004 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1241 microversion: 2.1 time: 0.114520 Jun 06 13:13:50.306299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 344/709] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:50 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1241 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:50.871047 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7ec9ff54-3d2e-412e-ac40-46909afb6ee7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:50.872384 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7ec9ff54-3d2e-412e-ac40-46909afb6ee7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:50.879586 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ec9ff54-3d2e-412e-ac40-46909afb6ee7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:50.880340 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ec9ff54-3d2e-412e-ac40-46909afb6ee7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:50.881423 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ec9ff54-3d2e-412e-ac40-46909afb6ee7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:50.882456 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ec9ff54-3d2e-412e-ac40-46909afb6ee7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:51.090013 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7ec9ff54-3d2e-412e-ac40-46909afb6ee7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:51.101099 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7ec9ff54-3d2e-412e-ac40-46909afb6ee7 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1689 microversion: 2.1 time: 0.235920 Jun 06 13:13:51.101790 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 366/710] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:50 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1689 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:51.323271 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3326c309-557c-4ed7-a8c8-f36402462d97 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:51.324687 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3326c309-557c-4ed7-a8c8-f36402462d97 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:51.331499 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3326c309-557c-4ed7-a8c8-f36402462d97 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:51.332661 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3326c309-557c-4ed7-a8c8-f36402462d97 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:51.334018 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3326c309-557c-4ed7-a8c8-f36402462d97 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:51.334691 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3326c309-557c-4ed7-a8c8-f36402462d97 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:51.420376 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3326c309-557c-4ed7-a8c8-f36402462d97 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:51.429838 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3326c309-557c-4ed7-a8c8-f36402462d97 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1289 microversion: 2.1 time: 0.110520 Jun 06 13:13:51.430431 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 345/711] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:51 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1289 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:52.119066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f94818f4-27be-4ad4-836b-385612b9a09a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:52.119713 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f94818f4-27be-4ad4-836b-385612b9a09a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:52.128729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f94818f4-27be-4ad4-836b-385612b9a09a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:52.129174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f94818f4-27be-4ad4-836b-385612b9a09a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:52.129955 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f94818f4-27be-4ad4-836b-385612b9a09a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:52.130439 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f94818f4-27be-4ad4-836b-385612b9a09a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:52.223171 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f94818f4-27be-4ad4-836b-385612b9a09a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:52.233203 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f94818f4-27be-4ad4-836b-385612b9a09a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1622 microversion: 2.1 time: 0.118648 Jun 06 13:13:52.236864 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 367/712] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:52 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1622 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:52.455057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3fa5ab88-634c-4856-b0fd-28523de82076 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:52.455057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3fa5ab88-634c-4856-b0fd-28523de82076 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:52.458022 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3fa5ab88-634c-4856-b0fd-28523de82076 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:52.458805 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3fa5ab88-634c-4856-b0fd-28523de82076 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:52.461813 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3fa5ab88-634c-4856-b0fd-28523de82076 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:52.462570 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3fa5ab88-634c-4856-b0fd-28523de82076 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:52.538808 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e529c932-28e8-4882-b560-3aeebdaf59df tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:52.539728 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e529c932-28e8-4882-b560-3aeebdaf59df tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:52.551859 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=70,nova_api:DELETE=1,nova_api:UPDATE=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:52.552049 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e529c932-28e8-4882-b560-3aeebdaf59df tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:52.552737 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e529c932-28e8-4882-b560-3aeebdaf59df tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:52.554114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e529c932-28e8-4882-b560-3aeebdaf59df tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:52.554560 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e529c932-28e8-4882-b560-3aeebdaf59df tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:52.604591 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e529c932-28e8-4882-b560-3aeebdaf59df tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/ips" status: 200 len: 149 microversion: 2.1 time: 0.361906 Jun 06 13:13:52.605624 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 346/713] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 13:13:52 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/ips => generated 149 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:52.744710 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3fa5ab88-634c-4856-b0fd-28523de82076 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:52.776248 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3fa5ab88-634c-4856-b0fd-28523de82076 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1295 microversion: 2.1 time: 0.330222 Jun 06 13:13:52.776248 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 368/714] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:52 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1295 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:13:52.815007 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-ab44b5d5-7117-4177-9459-10fb14ad4888 req-a9f8c233-61b4-47db-b272-3affefec34bf service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed", "name": "network-vif-deleted", "tag": "f0e7842e-73e3-4514-a0b0-f79d3d8a84f2"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:52.835112 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-ab44b5d5-7117-4177-9459-10fb14ad4888 req-a9f8c233-61b4-47db-b272-3affefec34bf service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:52.837403 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-ab44b5d5-7117-4177-9459-10fb14ad4888 req-a9f8c233-61b4-47db-b272-3affefec34bf service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:52.868071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-ab44b5d5-7117-4177-9459-10fb14ad4888 req-a9f8c233-61b4-47db-b272-3affefec34bf service nova] Creating event network-vif-deleted:f0e7842e-73e3-4514-a0b0-f79d3d8a84f2 for instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed on hv-cinder-75510 Jun 06 13:13:52.873398 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-ab44b5d5-7117-4177-9459-10fb14ad4888 req-a9f8c233-61b4-47db-b272-3affefec34bf service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.065062 Jun 06 13:13:52.874694 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 347/715] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:13:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 67 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:53.254115 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-54e81ca9-2710-41e8-b083-17e89febe521 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:53.256152 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-54e81ca9-2710-41e8-b083-17e89febe521 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:53.268245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-54e81ca9-2710-41e8-b083-17e89febe521 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:53.270685 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-54e81ca9-2710-41e8-b083-17e89febe521 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:53.273275 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-54e81ca9-2710-41e8-b083-17e89febe521 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:53.273930 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-54e81ca9-2710-41e8-b083-17e89febe521 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:53.329624 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-54e81ca9-2710-41e8-b083-17e89febe521 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:53.329624 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-54e81ca9-2710-41e8-b083-17e89febe521 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:53.329624 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-54e81ca9-2710-41e8-b083-17e89febe521 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lazy-loading 'fault' on Instance uuid a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:13:53.398104 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-54e81ca9-2710-41e8-b083-17e89febe521 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:53.406282 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-54e81ca9-2710-41e8-b083-17e89febe521 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 200 len: 1335 microversion: 2.1 time: 0.156421 Jun 06 13:13:53.407493 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 369/716] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:53 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 1335 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:53.794576 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-7e0f13c9-4890-4346-8cf7-91a737a49135 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:53.796034 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-7e0f13c9-4890-4346-8cf7-91a737a49135 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:53.815203 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7e0f13c9-4890-4346-8cf7-91a737a49135 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:53.817268 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7e0f13c9-4890-4346-8cf7-91a737a49135 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:53.822032 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7e0f13c9-4890-4346-8cf7-91a737a49135 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:53.822508 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7e0f13c9-4890-4346-8cf7-91a737a49135 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:54.259805 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-7e0f13c9-4890-4346-8cf7-91a737a49135 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:54.269627 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-7e0f13c9-4890-4346-8cf7-91a737a49135 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1361 microversion: 2.1 time: 0.483058 Jun 06 13:13:54.270216 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 348/717] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:53 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1361 bytes in 485 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:54.426296 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a104ed25-2c3d-4bf8-9ffe-3bb6ac6c1226 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:54.427627 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a104ed25-2c3d-4bf8-9ffe-3bb6ac6c1226 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:54.437043 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a104ed25-2c3d-4bf8-9ffe-3bb6ac6c1226 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:54.441414 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a104ed25-2c3d-4bf8-9ffe-3bb6ac6c1226 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:54.443107 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a104ed25-2c3d-4bf8-9ffe-3bb6ac6c1226 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:54.444796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a104ed25-2c3d-4bf8-9ffe-3bb6ac6c1226 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:54.479250 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-a104ed25-2c3d-4bf8-9ffe-3bb6ac6c1226 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] HTTP exception thrown: Instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed could not be found. Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a104ed25-2c3d-4bf8-9ffe-3bb6ac6c1226 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Request method failure captured: Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed HTTP/1.1 Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxZJTqH2tvjPaOfLf-GjKi9DdpfIw9vV-Dj8yIkT7Rz3rbj4seroxoGaC5amp93DC0XDdTji9E52xtlJmjDKJNS6ZcOTzI7g0ybI49K_1pbrztUd9_A_fsQh8uT7czdbHN5L1S_Ro5cLnbwPwf9s-JIk1_jyoTpeaVfStvrpu_2Lhk Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: d2263cfc378b4967ab4d2817991874f5 Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:13:54.483565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:13:54.485190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d2263cfc378b4967ab4d2817991874f5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d2263cfc378b4967ab4d2817991874f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d2263cfc378b4967ab4d2817991874f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d2263cfc378b4967ab4d2817991874f5"}]}] Jun 06 13:13:54.485190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:13:54.485190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: d2263cfc378b4967ab4d2817991874f5 Jun 06 13:13:54.485190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:13:54.485190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-ServerRescueNegativeTestJSON-1216849386-project Jun 06 13:13:54.485190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:13:54.485190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:13:54.485190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: e8410e3632ec4908824d336fff667da5 Jun 06 13:13:54.485190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1216849386-project Jun 06 13:13:54.485190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:13:54.485190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed could not be found. Jun 06 13:13:54.485190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': 'a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed'} Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed could not be found. Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:13:54.486066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed could not be found. Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed could not be found. Jun 06 13:13:54.487539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:13:54.489919 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a104ed25-2c3d-4bf8-9ffe-3bb6ac6c1226 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Returning 404 to user: Instance a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:13:54.491194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a104ed25-2c3d-4bf8-9ffe-3bb6ac6c1226 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed" status: 404 len: 111 microversion: 2.1 time: 0.070248 Jun 06 13:13:54.492326 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 370/718] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:54 2022] GET /compute/v2.1/servers/a5d18214-c6fb-4aec-b2ba-a6d3c383b5ed => generated 111 bytes in 72 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:13:54.512676 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ef475edf-56c7-44d4-9998-f2f7ffd83141 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '.version_select at 0x7f0efc0e6040>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:54.594543 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-de93f2e4-5d5a-4ec7-a264-61505de2f5a9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18b09fd4-0e2c-4150-8b48-be9679c67b77"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:54.596081 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-de93f2e4-5d5a-4ec7-a264-61505de2f5a9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:54.607906 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ef475edf-56c7-44d4-9998-f2f7ffd83141 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-807841164" status: 202 len: 0 microversion: 2.1 time: 0.106894 Jun 06 13:13:54.611805 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 349/719] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Jun 6 13:13:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-807841164 => generated 0 bytes in 112 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:13:54.611946 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de93f2e4-5d5a-4ec7-a264-61505de2f5a9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:54.611946 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de93f2e4-5d5a-4ec7-a264-61505de2f5a9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:54.611946 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de93f2e4-5d5a-4ec7-a264-61505de2f5a9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:54.611946 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de93f2e4-5d5a-4ec7-a264-61505de2f5a9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:54.621788 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:55.290288 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-8aa60dc7-85ec-4a7c-ae62-de1a3191203b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:55.292499 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8aa60dc7-85ec-4a7c-ae62-de1a3191203b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:55.303298 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8aa60dc7-85ec-4a7c-ae62-de1a3191203b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:55.304022 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8aa60dc7-85ec-4a7c-ae62-de1a3191203b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:55.305734 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8aa60dc7-85ec-4a7c-ae62-de1a3191203b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:55.308724 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8aa60dc7-85ec-4a7c-ae62-de1a3191203b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:55.469726 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-de93f2e4-5d5a-4ec7-a264-61505de2f5a9 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "POST /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.879102 Jun 06 13:13:55.470509 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 371/720] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:13:54 2022] POST /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments => generated 194 bytes in 881 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:13:55.671319 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-9091eab1-36e4-4796-9d86-1f44ed0b8c65 req-65895861-944b-4793-b96c-a51e66fb1796 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ff2f700-fdee-4fd2-a53f-92620522ffb2", "tag": "fb38f6a3-74c0-42c3-815b-dee79d43ae81"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:55.683042 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-9091eab1-36e4-4796-9d86-1f44ed0b8c65 req-65895861-944b-4793-b96c-a51e66fb1796 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:55.683804 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-9091eab1-36e4-4796-9d86-1f44ed0b8c65 req-65895861-944b-4793-b96c-a51e66fb1796 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:55.702078 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-9091eab1-36e4-4796-9d86-1f44ed0b8c65 req-65895861-944b-4793-b96c-a51e66fb1796 service nova] Creating event network-changed:fb38f6a3-74c0-42c3-815b-dee79d43ae81 for instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 on hv-cinder-75510 Jun 06 13:13:55.715340 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-9091eab1-36e4-4796-9d86-1f44ed0b8c65 req-65895861-944b-4793-b96c-a51e66fb1796 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.142920 Jun 06 13:13:55.715910 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 372/721] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:13:55 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:55.817690 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-8aa60dc7-85ec-4a7c-ae62-de1a3191203b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:55.831228 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-8aa60dc7-85ec-4a7c-ae62-de1a3191203b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1361 microversion: 2.1 time: 0.547607 Jun 06 13:13:55.831876 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 350/722] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:55 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1361 bytes in 549 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:56.851181 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c6ebe534-3d8f-4742-9008-4bdb36f05629 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:56.853493 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c6ebe534-3d8f-4742-9008-4bdb36f05629 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:56.861153 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6ebe534-3d8f-4742-9008-4bdb36f05629 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:56.861732 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6ebe534-3d8f-4742-9008-4bdb36f05629 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:56.862792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6ebe534-3d8f-4742-9008-4bdb36f05629 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:56.863690 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6ebe534-3d8f-4742-9008-4bdb36f05629 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:57.025947 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c6ebe534-3d8f-4742-9008-4bdb36f05629 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:57.034245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c6ebe534-3d8f-4742-9008-4bdb36f05629 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1361 microversion: 2.1 time: 0.188823 Jun 06 13:13:57.035176 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 373/723] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:56 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1361 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:57.176115 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e82dfb16-9ecb-47cc-93ab-77e34f9bc50b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Action: 'create', calling method: .version_select at 0x7f0efc0e6310>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-182726226", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNy1JQs7cMCiD5x0kQ47GuJBIy7NyEIG1GH9QlLGVSbtDbtJHaak9Bjl3RVR2Qv6cm4hElQsinurS4bCxgdJRoaI2blffUgXlRrndQw8MkittDahTZXhqEjurH0uN6MC3g=="}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:13:57.191170 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-e82dfb16-9ecb-47cc-93ab-77e34f9bc50b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Getting quotas for project 332996ee21f54ef3b78907332f5decce. Resources: {'key_pairs'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:13:57.195683 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-e82dfb16-9ecb-47cc-93ab-77e34f9bc50b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Getting quotas for user bd78c278513540ecadfc1a0f90b9ab16 and project 332996ee21f54ef3b78907332f5decce. Resources: {'key_pairs'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:13:57.266027 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e82dfb16-9ecb-47cc-93ab-77e34f9bc50b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 399 microversion: 2.1 time: 0.192956 Jun 06 13:13:57.266655 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 351/724] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 13:13:57 2022] POST /compute/v2.1/os-keypairs => generated 399 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:13:58.053579 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-49840296-3302-4f7a-830b-c72941ed66e6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:58.054804 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-49840296-3302-4f7a-830b-c72941ed66e6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:58.063569 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49840296-3302-4f7a-830b-c72941ed66e6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:58.064455 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49840296-3302-4f7a-830b-c72941ed66e6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:58.065447 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49840296-3302-4f7a-830b-c72941ed66e6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:58.066006 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49840296-3302-4f7a-830b-c72941ed66e6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:58.209428 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-49840296-3302-4f7a-830b-c72941ed66e6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:58.218047 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-49840296-3302-4f7a-830b-c72941ed66e6 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1361 microversion: 2.1 time: 0.170230 Jun 06 13:13:58.218624 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 374/725] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:58 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:58.975904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-805efe4a-fce7-48d7-ab06-b2bbe92ccbd6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:58.977189 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-805efe4a-fce7-48d7-ab06-b2bbe92ccbd6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:58.984583 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-805efe4a-fce7-48d7-ab06-b2bbe92ccbd6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:58.985362 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-805efe4a-fce7-48d7-ab06-b2bbe92ccbd6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:58.986461 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-805efe4a-fce7-48d7-ab06-b2bbe92ccbd6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:58.987137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-805efe4a-fce7-48d7-ab06-b2bbe92ccbd6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:59.014638 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-805efe4a-fce7-48d7-ab06-b2bbe92ccbd6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Going to try to terminate instance {{(pid=118134) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:13:59.235788 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2fb5223f-d0c1-46a6-9c3c-85551da1b9c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:59.237139 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2fb5223f-d0c1-46a6-9c3c-85551da1b9c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:59.244338 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:59.245316 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=10 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:13:59.247325 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2fb5223f-d0c1-46a6-9c3c-85551da1b9c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:59.247839 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2fb5223f-d0c1-46a6-9c3c-85551da1b9c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:59.248772 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2fb5223f-d0c1-46a6-9c3c-85551da1b9c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:59.249360 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2fb5223f-d0c1-46a6-9c3c-85551da1b9c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:59.401332 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2fb5223f-d0c1-46a6-9c3c-85551da1b9c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:59.408286 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2fb5223f-d0c1-46a6-9c3c-85551da1b9c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1361 microversion: 2.1 time: 0.176347 Jun 06 13:13:59.408868 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 375/726] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:59 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1361 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:13:59.421654 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-805efe4a-fce7-48d7-ab06-b2bbe92ccbd6 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "DELETE /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 204 len: 0 microversion: 2.1 time: 0.451214 Jun 06 13:13:59.422266 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 352/727] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:13:58 2022] DELETE /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:13:59.436074 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-420dc8a0-c6e3-45c9-9836-7ab1fd1aa888 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:13:59.437198 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-420dc8a0-c6e3-45c9-9836-7ab1fd1aa888 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:13:59.444073 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-420dc8a0-c6e3-45c9-9836-7ab1fd1aa888 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:59.444904 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-420dc8a0-c6e3-45c9-9836-7ab1fd1aa888 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:59.445969 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-420dc8a0-c6e3-45c9-9836-7ab1fd1aa888 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:13:59.446623 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-420dc8a0-c6e3-45c9-9836-7ab1fd1aa888 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:13:59.632709 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-420dc8a0-c6e3-45c9-9836-7ab1fd1aa888 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:13:59.641521 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-420dc8a0-c6e3-45c9-9836-7ab1fd1aa888 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1509 microversion: 2.1 time: 0.210499 Jun 06 13:13:59.642653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 376/728] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:13:59 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1509 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:00.426977 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f4e60c1e-5752-400a-b1cf-08f191f3f10d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:00.431090 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f4e60c1e-5752-400a-b1cf-08f191f3f10d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:00.442528 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f4e60c1e-5752-400a-b1cf-08f191f3f10d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:00.442990 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f4e60c1e-5752-400a-b1cf-08f191f3f10d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:00.445683 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f4e60c1e-5752-400a-b1cf-08f191f3f10d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:00.445683 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f4e60c1e-5752-400a-b1cf-08f191f3f10d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:00.633370 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f4e60c1e-5752-400a-b1cf-08f191f3f10d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:00.650327 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f4e60c1e-5752-400a-b1cf-08f191f3f10d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1361 microversion: 2.1 time: 0.227754 Jun 06 13:14:00.654993 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 353/729] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:00 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1361 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:00.671151 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c22ee68e-b2a6-43cf-b0aa-2fd329080971 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:00.678490 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c22ee68e-b2a6-43cf-b0aa-2fd329080971 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:00.683056 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c22ee68e-b2a6-43cf-b0aa-2fd329080971 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:00.683514 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c22ee68e-b2a6-43cf-b0aa-2fd329080971 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:00.684403 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c22ee68e-b2a6-43cf-b0aa-2fd329080971 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:00.685137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c22ee68e-b2a6-43cf-b0aa-2fd329080971 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:00.840631 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c22ee68e-b2a6-43cf-b0aa-2fd329080971 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:00.851470 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c22ee68e-b2a6-43cf-b0aa-2fd329080971 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1509 microversion: 2.1 time: 0.187183 Jun 06 13:14:00.852091 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 377/730] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:00 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1509 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:01.671802 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ddffb631-b306-428d-bf5c-a84fcea80656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:01.672442 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ddffb631-b306-428d-bf5c-a84fcea80656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:01.679992 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ddffb631-b306-428d-bf5c-a84fcea80656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:01.680445 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ddffb631-b306-428d-bf5c-a84fcea80656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:01.681221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ddffb631-b306-428d-bf5c-a84fcea80656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:01.681688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ddffb631-b306-428d-bf5c-a84fcea80656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:01.816137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ddffb631-b306-428d-bf5c-a84fcea80656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:01.824555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ddffb631-b306-428d-bf5c-a84fcea80656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1361 microversion: 2.1 time: 0.156575 Jun 06 13:14:01.825131 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 354/731] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:01 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1361 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:01.869403 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1a870d17-c26c-4daf-a9f1-8f72336757cf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:01.869964 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1a870d17-c26c-4daf-a9f1-8f72336757cf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:01.876619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1a870d17-c26c-4daf-a9f1-8f72336757cf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:01.877070 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1a870d17-c26c-4daf-a9f1-8f72336757cf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:01.877827 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1a870d17-c26c-4daf-a9f1-8f72336757cf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:01.878262 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1a870d17-c26c-4daf-a9f1-8f72336757cf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:02.020093 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1a870d17-c26c-4daf-a9f1-8f72336757cf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:02.030736 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1a870d17-c26c-4daf-a9f1-8f72336757cf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1509 microversion: 2.1 time: 0.165898 Jun 06 13:14:02.031378 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 378/732] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:01 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1509 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:02.383349 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-e703bc71-712d-483e-bb9c-08252fb4a9fd req-782e723f-523c-4523-8f74-a8f554c96d09 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff2f700-fdee-4fd2-a53f-92620522ffb2", "name": "network-vif-plugged", "status": "completed", "tag": "fb38f6a3-74c0-42c3-815b-dee79d43ae81"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:02.395016 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-e703bc71-712d-483e-bb9c-08252fb4a9fd req-782e723f-523c-4523-8f74-a8f554c96d09 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:02.395016 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-e703bc71-712d-483e-bb9c-08252fb4a9fd req-782e723f-523c-4523-8f74-a8f554c96d09 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:02.406103 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-e703bc71-712d-483e-bb9c-08252fb4a9fd req-782e723f-523c-4523-8f74-a8f554c96d09 service nova] Creating event network-vif-plugged:fb38f6a3-74c0-42c3-815b-dee79d43ae81 for instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 on hv-cinder-75510 Jun 06 13:14:02.448831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-e703bc71-712d-483e-bb9c-08252fb4a9fd req-782e723f-523c-4523-8f74-a8f554c96d09 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.093834 Jun 06 13:14:02.448831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 355/733] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:02 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:02.844201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ef40655e-259d-4ae0-98d4-7d01449f257a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:02.844893 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ef40655e-259d-4ae0-98d4-7d01449f257a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:02.852204 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef40655e-259d-4ae0-98d4-7d01449f257a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:02.852750 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef40655e-259d-4ae0-98d4-7d01449f257a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:02.853576 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef40655e-259d-4ae0-98d4-7d01449f257a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:02.854773 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef40655e-259d-4ae0-98d4-7d01449f257a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:03.051416 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b642333c-6af9-43b8-80ed-0636d23de401 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:03.052092 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b642333c-6af9-43b8-80ed-0636d23de401 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:03.067569 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b642333c-6af9-43b8-80ed-0636d23de401 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:03.068790 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b642333c-6af9-43b8-80ed-0636d23de401 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:03.070113 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b642333c-6af9-43b8-80ed-0636d23de401 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:03.070737 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b642333c-6af9-43b8-80ed-0636d23de401 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:03.073722 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:03.131650 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ef40655e-259d-4ae0-98d4-7d01449f257a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:03.140510 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ef40655e-259d-4ae0-98d4-7d01449f257a tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1361 microversion: 2.1 time: 0.300188 Jun 06 13:14:03.141545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 379/734] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:02 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1361 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:03.146022 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-87f20d18-464a-405c-b9ee-1aca334865f5 req-1a51f902-be24-4fdf-8e50-8b79f4928059 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "a52d4675-f6b5-4381-a005-d9ba7c7c4b90", "name": "network-vif-deleted", "tag": "5d6dcaaf-ad13-4769-b8b2-14bbc7134365"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:03.155193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b642333c-6af9-43b8-80ed-0636d23de401 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:03.156250 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-87f20d18-464a-405c-b9ee-1aca334865f5 req-1a51f902-be24-4fdf-8e50-8b79f4928059 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:03.156691 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-87f20d18-464a-405c-b9ee-1aca334865f5 req-1a51f902-be24-4fdf-8e50-8b79f4928059 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:03.163608 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b642333c-6af9-43b8-80ed-0636d23de401 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1467 microversion: 2.1 time: 0.116843 Jun 06 13:14:03.165548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 356/735] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:03 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1467 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:03.170098 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-87f20d18-464a-405c-b9ee-1aca334865f5 req-1a51f902-be24-4fdf-8e50-8b79f4928059 service nova] Creating event network-vif-deleted:5d6dcaaf-ad13-4769-b8b2-14bbc7134365 for instance a52d4675-f6b5-4381-a005-d9ba7c7c4b90 on hv-cinder-75510 Jun 06 13:14:03.175205 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-87f20d18-464a-405c-b9ee-1aca334865f5 req-1a51f902-be24-4fdf-8e50-8b79f4928059 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032568 Jun 06 13:14:03.175808 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 380/736] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:04.158166 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a2652641-7c91-4f7f-a9d9-4cf8ece9cb74 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:04.158801 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a2652641-7c91-4f7f-a9d9-4cf8ece9cb74 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:04.166535 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a2652641-7c91-4f7f-a9d9-4cf8ece9cb74 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:04.166984 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a2652641-7c91-4f7f-a9d9-4cf8ece9cb74 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:04.167853 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a2652641-7c91-4f7f-a9d9-4cf8ece9cb74 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:04.168273 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a2652641-7c91-4f7f-a9d9-4cf8ece9cb74 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:04.183275 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7be388a1-a21d-48db-9793-2b76c2c6351a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:04.184085 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7be388a1-a21d-48db-9793-2b76c2c6351a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:04.190770 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7be388a1-a21d-48db-9793-2b76c2c6351a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:04.191278 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7be388a1-a21d-48db-9793-2b76c2c6351a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:04.192128 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7be388a1-a21d-48db-9793-2b76c2c6351a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:04.192643 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7be388a1-a21d-48db-9793-2b76c2c6351a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:04.230224 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7be388a1-a21d-48db-9793-2b76c2c6351a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:04.230780 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7be388a1-a21d-48db-9793-2b76c2c6351a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:04.231241 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-7be388a1-a21d-48db-9793-2b76c2c6351a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lazy-loading 'fault' on Instance uuid a52d4675-f6b5-4381-a005-d9ba7c7c4b90 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:14:04.501381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7be388a1-a21d-48db-9793-2b76c2c6351a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:04.509999 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7be388a1-a21d-48db-9793-2b76c2c6351a tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 200 len: 1312 microversion: 2.1 time: 0.330908 Jun 06 13:14:04.510582 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 381/737] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:04 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 1312 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:04.520233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-752c1802-8608-4086-a9a6-68fd4a86740b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "18b09fd4-0e2c-4150-8b48-be9679c67b77"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:04.520233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-752c1802-8608-4086-a9a6-68fd4a86740b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:04.524431 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-752c1802-8608-4086-a9a6-68fd4a86740b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:04.524882 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-752c1802-8608-4086-a9a6-68fd4a86740b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:04.525686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-752c1802-8608-4086-a9a6-68fd4a86740b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:04.526117 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-752c1802-8608-4086-a9a6-68fd4a86740b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:04.564532 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a2652641-7c91-4f7f-a9d9-4cf8ece9cb74 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:04.573239 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a2652641-7c91-4f7f-a9d9-4cf8ece9cb74 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1361 microversion: 2.1 time: 0.419138 Jun 06 13:14:04.574439 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 357/738] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:04 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1361 bytes in 421 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:04.616991 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-752c1802-8608-4086-a9a6-68fd4a86740b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Invalid volume: volume 18b09fd4-0e2c-4150-8b48-be9679c67b77 is already attached to instances: d70800c6-f31a-4b07-9a99-98a2e5ff905c Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-752c1802-8608-4086-a9a6-68fd4a86740b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: POST /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments HTTP/1.1 Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 74 Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:14:04.618640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:14:04.624381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:14:04.624381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:14:04.624381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:14:04.624381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:14:04.624381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:14:04.624381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:14:04.624381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:14:04.624381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:14:04.624381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:14:04.624381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Jun 06 13:14:04.624381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {"volumeAttachment": {"volumeId": "18b09fd4-0e2c-4150-8b48-be9679c67b77"}} Jun 06 13:14:04.624381 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Invalid volume: volume 18b09fd4-0e2c-4150-8b48-be9679c67b77 is already attached to instances: d70800c6-f31a-4b07-9a99-98a2e5ff905c Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'server_id': 'd70800c6-f31a-4b07-9a99-98a2e5ff905c', 'body': {'volumeAttachment': {'volumeId': '18b09fd4-0e2c-4150-8b48-be9679c67b77'}}} Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 238, in inner Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 164, in inner Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4985, in attach_volume Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4825, in _check_volume_already_attached Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 18b09fd4-0e2c-4150-8b48-be9679c67b77 is already attached to instances: d70800c6-f31a-4b07-9a99-98a2e5ff905c Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:04.625287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 18b09fd4-0e2c-4150-8b48-be9679c67b77 is already attached to instances: d70800c6-f31a-4b07-9a99-98a2e5ff905c Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:04.626725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:04.628433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:04.628433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:14:04.628433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:14:04.628433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 18b09fd4-0e2c-4150-8b48-be9679c67b77 is already attached to instances: d70800c6-f31a-4b07-9a99-98a2e5ff905c Jun 06 13:14:04.628433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:04.628433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-752c1802-8608-4086-a9a6-68fd4a86740b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 400 to user: Invalid volume: volume 18b09fd4-0e2c-4150-8b48-be9679c67b77 is already attached to instances: d70800c6-f31a-4b07-9a99-98a2e5ff905c {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:14:04.628433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-752c1802-8608-4086-a9a6-68fd4a86740b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "POST /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.108434 Jun 06 13:14:04.628433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 382/739] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:14:04 2022] POST /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments => generated 174 bytes in 109 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 13:14:04.683346 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-25a0f049-f7d4-4795-89e3-6c18f0fc5f41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:04.683900 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-25a0f049-f7d4-4795-89e3-6c18f0fc5f41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:04.689800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-25a0f049-f7d4-4795-89e3-6c18f0fc5f41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:04.690243 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-25a0f049-f7d4-4795-89e3-6c18f0fc5f41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:04.691002 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-25a0f049-f7d4-4795-89e3-6c18f0fc5f41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:04.691428 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-25a0f049-f7d4-4795-89e3-6c18f0fc5f41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:04.773977 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-25a0f049-f7d4-4795-89e3-6c18f0fc5f41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lazy-loading 'services' on Instance uuid d70800c6-f31a-4b07-9a99-98a2e5ff905c {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:14:05.007755 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-25a0f049-f7d4-4795-89e3-6c18f0fc5f41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments/18b09fd4-0e2c-4150-8b48-be9679c67b77" status: 202 len: 0 microversion: 2.1 time: 0.328199 Jun 06 13:14:05.008405 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 358/740] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 13:14:04 2022] DELETE /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments/18b09fd4-0e2c-4150-8b48-be9679c67b77 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:14:05.017843 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e7dfb815-8ea5-47db-b308-4e5a6010aadc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:05.023220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e7dfb815-8ea5-47db-b308-4e5a6010aadc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:05.029591 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7dfb815-8ea5-47db-b308-4e5a6010aadc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:05.031091 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7dfb815-8ea5-47db-b308-4e5a6010aadc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:05.031091 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7dfb815-8ea5-47db-b308-4e5a6010aadc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:05.031341 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e7dfb815-8ea5-47db-b308-4e5a6010aadc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:05.063799 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e7dfb815-8ea5-47db-b308-4e5a6010aadc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050044 Jun 06 13:14:05.064391 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 383/741] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:14:05 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:14:05.528385 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-717177ca-9abd-4d2e-a8e6-ec172881cb47 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:05.529137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-717177ca-9abd-4d2e-a8e6-ec172881cb47 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: a52d4675-f6b5-4381-a005-d9ba7c7c4b90] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:05.536827 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-717177ca-9abd-4d2e-a8e6-ec172881cb47 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:05.537390 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-717177ca-9abd-4d2e-a8e6-ec172881cb47 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:05.538691 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-717177ca-9abd-4d2e-a8e6-ec172881cb47 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:05.539204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-717177ca-9abd-4d2e-a8e6-ec172881cb47 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:05.554495 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-717177ca-9abd-4d2e-a8e6-ec172881cb47 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] HTTP exception thrown: Instance a52d4675-f6b5-4381-a005-d9ba7c7c4b90 could not be found. Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-717177ca-9abd-4d2e-a8e6-ec172881cb47 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Request method failure captured: Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 HTTP/1.1 Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxZJTqH2tvjPaOfLf-GjKi9DdpfIw9vV-Dj8yIkT7Rz3rbj4seroxoGaC5amp93DC0XDdTji9E52xtlJmjDKJNS6ZcOTzI7g0ybI49K_1pbrztUd9_A_fsQh8uT7czdbHN5L1S_Ro5cLnbwPwf9s-JIk1_jyoTpeaVfStvrpu_2Lhk Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: d2263cfc378b4967ab4d2817991874f5 Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:14:05.556171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:14:05.557670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d2263cfc378b4967ab4d2817991874f5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d2263cfc378b4967ab4d2817991874f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d2263cfc378b4967ab4d2817991874f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d2263cfc378b4967ab4d2817991874f5"}]}] Jun 06 13:14:05.557670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:14:05.557670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: d2263cfc378b4967ab4d2817991874f5 Jun 06 13:14:05.557670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:14:05.557670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-ServerRescueNegativeTestJSON-1216849386-project Jun 06 13:14:05.557670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:14:05.557670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:14:05.557670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: e8410e3632ec4908824d336fff667da5 Jun 06 13:14:05.557670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1216849386-project Jun 06 13:14:05.557670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:14:05.557670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance a52d4675-f6b5-4381-a005-d9ba7c7c4b90 could not be found. Jun 06 13:14:05.557670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': 'a52d4675-f6b5-4381-a005-d9ba7c7c4b90'} Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance a52d4675-f6b5-4381-a005-d9ba7c7c4b90 could not be found. Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:14:05.558712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance a52d4675-f6b5-4381-a005-d9ba7c7c4b90 could not be found. Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance a52d4675-f6b5-4381-a005-d9ba7c7c4b90 could not be found. Jun 06 13:14:05.560308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:05.561603 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-717177ca-9abd-4d2e-a8e6-ec172881cb47 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Returning 404 to user: Instance a52d4675-f6b5-4381-a005-d9ba7c7c4b90 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:14:05.561603 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-717177ca-9abd-4d2e-a8e6-ec172881cb47 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90" status: 404 len: 111 microversion: 2.1 time: 0.033615 Jun 06 13:14:05.561603 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 359/742] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:05 2022] GET /compute/v2.1/servers/a52d4675-f6b5-4381-a005-d9ba7c7c4b90 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:14:05.566418 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-adbaccf4-02ca-4aa2-94cb-e82259e6bb5c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:05.566905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-adbaccf4-02ca-4aa2-94cb-e82259e6bb5c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:05.574670 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-adbaccf4-02ca-4aa2-94cb-e82259e6bb5c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:05.575115 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-adbaccf4-02ca-4aa2-94cb-e82259e6bb5c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:05.575905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-adbaccf4-02ca-4aa2-94cb-e82259e6bb5c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:05.576335 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-adbaccf4-02ca-4aa2-94cb-e82259e6bb5c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:05.590235 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5941d6b9-4f23-49ab-9bef-cfe40e48d96f tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:05.590941 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5941d6b9-4f23-49ab-9bef-cfe40e48d96f tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:05.597039 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5941d6b9-4f23-49ab-9bef-cfe40e48d96f tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:05.597562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5941d6b9-4f23-49ab-9bef-cfe40e48d96f tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:05.598430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5941d6b9-4f23-49ab-9bef-cfe40e48d96f tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:05.598867 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5941d6b9-4f23-49ab-9bef-cfe40e48d96f tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:05.601573 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-adbaccf4-02ca-4aa2-94cb-e82259e6bb5c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:14:05.732574 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5941d6b9-4f23-49ab-9bef-cfe40e48d96f tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:05.740794 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5941d6b9-4f23-49ab-9bef-cfe40e48d96f tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1547 microversion: 2.1 time: 0.153865 Jun 06 13:14:05.741421 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 360/743] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:05 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1547 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:14:05.759127 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-7b887f39-dfb8-452e-ab3b-854e9c7adbbc tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:05.759989 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-7b887f39-dfb8-452e-ab3b-854e9c7adbbc tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:05.765995 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b887f39-dfb8-452e-ab3b-854e9c7adbbc tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:05.766450 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b887f39-dfb8-452e-ab3b-854e9c7adbbc tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:05.767223 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b887f39-dfb8-452e-ab3b-854e9c7adbbc tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:05.767694 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7b887f39-dfb8-452e-ab3b-854e9c7adbbc tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:05.852047 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-7b887f39-dfb8-452e-ab3b-854e9c7adbbc tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.097045 Jun 06 13:14:05.853023 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 361/744] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 13:14:05 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-interface => generated 284 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:14:05.908800 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-adbaccf4-02ca-4aa2-94cb-e82259e6bb5c tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "DELETE /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 204 len: 0 microversion: 2.1 time: 0.345869 Jun 06 13:14:05.909545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 384/745] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:14:05 2022] DELETE /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 0 bytes in 348 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:14:05.918822 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0dfd0c5f-dd61-417d-800c-41327d1fa5d3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:05.919615 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0dfd0c5f-dd61-417d-800c-41327d1fa5d3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:05.930573 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0dfd0c5f-dd61-417d-800c-41327d1fa5d3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:05.931680 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0dfd0c5f-dd61-417d-800c-41327d1fa5d3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:05.932399 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0dfd0c5f-dd61-417d-800c-41327d1fa5d3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:05.932848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0dfd0c5f-dd61-417d-800c-41327d1fa5d3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:06.083362 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0eadb4e0-37ce-4778-9a5a-bc1c8f9a95de tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:06.083362 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0eadb4e0-37ce-4778-9a5a-bc1c8f9a95de tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:06.084486 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-0dfd0c5f-dd61-417d-800c-41327d1fa5d3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:06.094042 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0dfd0c5f-dd61-417d-800c-41327d1fa5d3 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.179211 Jun 06 13:14:06.094622 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 362/746] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:05 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:14:06.099785 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0eadb4e0-37ce-4778-9a5a-bc1c8f9a95de tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:06.100228 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0eadb4e0-37ce-4778-9a5a-bc1c8f9a95de tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:06.101206 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0eadb4e0-37ce-4778-9a5a-bc1c8f9a95de tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:06.101794 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0eadb4e0-37ce-4778-9a5a-bc1c8f9a95de tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:06.129056 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:06.135141 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0eadb4e0-37ce-4778-9a5a-bc1c8f9a95de tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.062377 Jun 06 13:14:06.137013 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 385/747] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:14:06 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments => generated 197 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:14:06.943325 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-6e46fdf8-7e81-4180-825a-8fc127e3e392 req-844c292a-e163-470c-9170-07b4d8d2955b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ff2f700-fdee-4fd2-a53f-92620522ffb2", "tag": "fb38f6a3-74c0-42c3-815b-dee79d43ae81"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:06.952623 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-6e46fdf8-7e81-4180-825a-8fc127e3e392 req-844c292a-e163-470c-9170-07b4d8d2955b service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:06.953389 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-6e46fdf8-7e81-4180-825a-8fc127e3e392 req-844c292a-e163-470c-9170-07b4d8d2955b service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:06.967009 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-6e46fdf8-7e81-4180-825a-8fc127e3e392 req-844c292a-e163-470c-9170-07b4d8d2955b service nova] Creating event network-changed:fb38f6a3-74c0-42c3-815b-dee79d43ae81 for instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 on hv-cinder-75510 Jun 06 13:14:06.972036 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-6e46fdf8-7e81-4180-825a-8fc127e3e392 req-844c292a-e163-470c-9170-07b4d8d2955b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.093658 Jun 06 13:14:06.972609 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 363/748] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:07.112454 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5e02f3a6-9ccb-4f31-96d1-a53e516bbefd tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:07.113055 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5e02f3a6-9ccb-4f31-96d1-a53e516bbefd tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:07.120455 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e02f3a6-9ccb-4f31-96d1-a53e516bbefd tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:07.120908 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e02f3a6-9ccb-4f31-96d1-a53e516bbefd tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:07.121731 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e02f3a6-9ccb-4f31-96d1-a53e516bbefd tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:07.122234 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e02f3a6-9ccb-4f31-96d1-a53e516bbefd tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:07.150205 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b1a15266-14f7-4492-87bd-8f84c9a85861 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:07.151542 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b1a15266-14f7-4492-87bd-8f84c9a85861 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:07.158587 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1a15266-14f7-4492-87bd-8f84c9a85861 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:07.159310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1a15266-14f7-4492-87bd-8f84c9a85861 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:07.160462 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1a15266-14f7-4492-87bd-8f84c9a85861 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:07.160891 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b1a15266-14f7-4492-87bd-8f84c9a85861 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:07.193605 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b1a15266-14f7-4492-87bd-8f84c9a85861 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050547 Jun 06 13:14:07.194529 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 364/749] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:14:07 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:14:07.268425 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5e02f3a6-9ccb-4f31-96d1-a53e516bbefd tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:07.276745 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5e02f3a6-9ccb-4f31-96d1-a53e516bbefd tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.168567 Jun 06 13:14:07.277308 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 386/750] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:07 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:08.204446 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c8ac8a0f-510a-4263-b694-d2e45b09d36d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:08.205404 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c8ac8a0f-510a-4263-b694-d2e45b09d36d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:08.207356 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=6 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:08.213722 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c8ac8a0f-510a-4263-b694-d2e45b09d36d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:08.219165 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c8ac8a0f-510a-4263-b694-d2e45b09d36d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:08.219165 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c8ac8a0f-510a-4263-b694-d2e45b09d36d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:08.219165 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c8ac8a0f-510a-4263-b694-d2e45b09d36d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:08.248145 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c8ac8a0f-510a-4263-b694-d2e45b09d36d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047490 Jun 06 13:14:08.248740 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 365/751] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:14:08 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:08.294005 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1bdf6e58-18c0-424b-b6be-9e00e11fb13e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:08.294633 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1bdf6e58-18c0-424b-b6be-9e00e11fb13e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:08.301141 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1bdf6e58-18c0-424b-b6be-9e00e11fb13e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:08.301593 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1bdf6e58-18c0-424b-b6be-9e00e11fb13e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:08.302355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1bdf6e58-18c0-424b-b6be-9e00e11fb13e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:08.302953 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1bdf6e58-18c0-424b-b6be-9e00e11fb13e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:08.438412 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1bdf6e58-18c0-424b-b6be-9e00e11fb13e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:08.446729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1bdf6e58-18c0-424b-b6be-9e00e11fb13e tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1522 microversion: 2.1 time: 0.156990 Jun 06 13:14:08.447296 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 387/752] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:08 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1522 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:09.260965 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d1c06c69-222d-4fca-bed7-216f2e0c4277 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:09.261974 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d1c06c69-222d-4fca-bed7-216f2e0c4277 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:09.269117 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d1c06c69-222d-4fca-bed7-216f2e0c4277 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:09.269586 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d1c06c69-222d-4fca-bed7-216f2e0c4277 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:09.270335 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d1c06c69-222d-4fca-bed7-216f2e0c4277 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:09.271027 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d1c06c69-222d-4fca-bed7-216f2e0c4277 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:09.300228 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d1c06c69-222d-4fca-bed7-216f2e0c4277 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044022 Jun 06 13:14:09.300792 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 366/753] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:14:09 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 13:14:09.362476 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-46710e28-7d7b-45bc-b803-bae7bd90a94b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:09.368434 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-46710e28-7d7b-45bc-b803-bae7bd90a94b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:09.370906 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46710e28-7d7b-45bc-b803-bae7bd90a94b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:09.371331 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46710e28-7d7b-45bc-b803-bae7bd90a94b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:09.372356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46710e28-7d7b-45bc-b803-bae7bd90a94b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:09.372803 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-46710e28-7d7b-45bc-b803-bae7bd90a94b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:09.407748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-46710e28-7d7b-45bc-b803-bae7bd90a94b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:14:09.455246 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-618ebfca-8c02-44be-9502-f753eaf89b4a req-0569aacb-8a05-4f3b-9e1d-0a6c16a028c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5c50c488-a0ae-4331-9dfe-5fb0b7ab5108", "name": "network-vif-deleted", "tag": "2afcefdf-f52a-4b50-9bf5-21e35aed0ff2"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:09.464530 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-618ebfca-8c02-44be-9502-f753eaf89b4a req-0569aacb-8a05-4f3b-9e1d-0a6c16a028c8 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:09.464972 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-618ebfca-8c02-44be-9502-f753eaf89b4a req-0569aacb-8a05-4f3b-9e1d-0a6c16a028c8 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:09.478930 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-618ebfca-8c02-44be-9502-f753eaf89b4a req-0569aacb-8a05-4f3b-9e1d-0a6c16a028c8 service nova] Creating event network-vif-deleted:2afcefdf-f52a-4b50-9bf5-21e35aed0ff2 for instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 on hv-cinder-75510 Jun 06 13:14:09.484230 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-618ebfca-8c02-44be-9502-f753eaf89b4a req-0569aacb-8a05-4f3b-9e1d-0a6c16a028c8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032609 Jun 06 13:14:09.485007 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 367/754] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:09 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:14:09.490814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-98ad0d33-0ed0-4c7e-bc43-770007385d99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:09.491942 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-98ad0d33-0ed0-4c7e-bc43-770007385d99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:09.498489 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-98ad0d33-0ed0-4c7e-bc43-770007385d99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:09.499170 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-98ad0d33-0ed0-4c7e-bc43-770007385d99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:09.500229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-98ad0d33-0ed0-4c7e-bc43-770007385d99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:09.500675 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-98ad0d33-0ed0-4c7e-bc43-770007385d99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:09.572225 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-98ad0d33-0ed0-4c7e-bc43-770007385d99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:09.579874 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-98ad0d33-0ed0-4c7e-bc43-770007385d99 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1480 microversion: 2.1 time: 0.093651 Jun 06 13:14:09.580434 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 368/755] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:09 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1480 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:09.682461 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-46710e28-7d7b-45bc-b803-bae7bd90a94b tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 204 len: 0 microversion: 2.1 time: 0.323641 Jun 06 13:14:09.682954 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 388/756] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:14:09 2022] DELETE /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 0 bytes in 325 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:14:09.691178 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6d5ab46e-8f76-43c9-848b-ef848924c6e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:09.691932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6d5ab46e-8f76-43c9-848b-ef848924c6e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:09.699181 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6d5ab46e-8f76-43c9-848b-ef848924c6e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:09.699689 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6d5ab46e-8f76-43c9-848b-ef848924c6e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:09.700675 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6d5ab46e-8f76-43c9-848b-ef848924c6e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:09.701169 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6d5ab46e-8f76-43c9-848b-ef848924c6e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:09.843407 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6d5ab46e-8f76-43c9-848b-ef848924c6e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:09.851453 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6d5ab46e-8f76-43c9-848b-ef848924c6e7 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1679 microversion: 2.1 time: 0.164029 Jun 06 13:14:09.852150 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 369/757] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:09 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1679 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:10.597795 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ef31bb1f-950d-4778-951d-2423e02e1bcf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:10.598477 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ef31bb1f-950d-4778-951d-2423e02e1bcf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:10.604945 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef31bb1f-950d-4778-951d-2423e02e1bcf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:10.605384 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef31bb1f-950d-4778-951d-2423e02e1bcf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:10.606130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef31bb1f-950d-4778-951d-2423e02e1bcf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:10.606558 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef31bb1f-950d-4778-951d-2423e02e1bcf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:10.640208 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef31bb1f-950d-4778-951d-2423e02e1bcf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:10.640644 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ef31bb1f-950d-4778-951d-2423e02e1bcf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:10.641080 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-ef31bb1f-950d-4778-951d-2423e02e1bcf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lazy-loading 'fault' on Instance uuid 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:14:10.684483 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ef31bb1f-950d-4778-951d-2423e02e1bcf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:10.691941 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ef31bb1f-950d-4778-951d-2423e02e1bcf tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1311 microversion: 2.1 time: 0.098371 Jun 06 13:14:10.692476 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 389/758] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:10 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1311 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:10.869655 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bdec9602-ebc6-4ee3-a5f2-215687175ea6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:10.870495 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-bdec9602-ebc6-4ee3-a5f2-215687175ea6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:10.876884 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bdec9602-ebc6-4ee3-a5f2-215687175ea6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:10.877330 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bdec9602-ebc6-4ee3-a5f2-215687175ea6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:10.878119 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bdec9602-ebc6-4ee3-a5f2-215687175ea6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:10.878546 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bdec9602-ebc6-4ee3-a5f2-215687175ea6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:11.010019 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-bdec9602-ebc6-4ee3-a5f2-215687175ea6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:11.017779 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-bdec9602-ebc6-4ee3-a5f2-215687175ea6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1679 microversion: 2.1 time: 0.152590 Jun 06 13:14:11.018347 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 370/759] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:10 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1679 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:11.709077 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3c4546d8-22e5-4480-8b4a-1b36a98ea562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:11.710196 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3c4546d8-22e5-4480-8b4a-1b36a98ea562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:11.719274 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3c4546d8-22e5-4480-8b4a-1b36a98ea562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:11.719766 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3c4546d8-22e5-4480-8b4a-1b36a98ea562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:11.720561 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3c4546d8-22e5-4480-8b4a-1b36a98ea562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:11.720999 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3c4546d8-22e5-4480-8b4a-1b36a98ea562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:11.753558 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3c4546d8-22e5-4480-8b4a-1b36a98ea562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:11.754045 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3c4546d8-22e5-4480-8b4a-1b36a98ea562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:11.754516 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-3c4546d8-22e5-4480-8b4a-1b36a98ea562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lazy-loading 'fault' on Instance uuid 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:14:11.799951 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3c4546d8-22e5-4480-8b4a-1b36a98ea562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e8410e3632ec4908824d336fff667da5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd2263cfc378b4967ab4d2817991874f5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:11.809009 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3c4546d8-22e5-4480-8b4a-1b36a98ea562 tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 200 len: 1311 microversion: 2.1 time: 0.103767 Jun 06 13:14:11.809713 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 390/760] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:11 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 1311 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:12.036602 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3f47ac18-3ee7-4865-83e2-f7d2c1945e55 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:12.037374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3f47ac18-3ee7-4865-83e2-f7d2c1945e55 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:12.044825 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3f47ac18-3ee7-4865-83e2-f7d2c1945e55 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:12.045316 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3f47ac18-3ee7-4865-83e2-f7d2c1945e55 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:12.046109 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3f47ac18-3ee7-4865-83e2-f7d2c1945e55 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:12.046550 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3f47ac18-3ee7-4865-83e2-f7d2c1945e55 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:12.185081 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3f47ac18-3ee7-4865-83e2-f7d2c1945e55 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:12.209333 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3f47ac18-3ee7-4865-83e2-f7d2c1945e55 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1679 microversion: 2.1 time: 0.175914 Jun 06 13:14:12.211774 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 371/761] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:12 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1679 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:12.624636 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-f09d7f7c-c183-459c-9aa6-5a932905b814 req-bfc26d5a-350a-40a3-9f89-6df3a9f5b7f2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d70800c6-f31a-4b07-9a99-98a2e5ff905c", "name": "network-vif-deleted", "tag": "b6f802cc-0b4f-47e5-b3f9-802ff41af6df"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:12.634300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-f09d7f7c-c183-459c-9aa6-5a932905b814 req-bfc26d5a-350a-40a3-9f89-6df3a9f5b7f2 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:12.634796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-f09d7f7c-c183-459c-9aa6-5a932905b814 req-bfc26d5a-350a-40a3-9f89-6df3a9f5b7f2 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:12.646567 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-f09d7f7c-c183-459c-9aa6-5a932905b814 req-bfc26d5a-350a-40a3-9f89-6df3a9f5b7f2 service nova] Creating event network-vif-deleted:b6f802cc-0b4f-47e5-b3f9-802ff41af6df for instance d70800c6-f31a-4b07-9a99-98a2e5ff905c on hv-cinder-75510 Jun 06 13:14:12.652032 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-f09d7f7c-c183-459c-9aa6-5a932905b814 req-bfc26d5a-350a-40a3-9f89-6df3a9f5b7f2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035595 Jun 06 13:14:12.653006 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 391/762] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:12 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:12.828303 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-dc3906ff-15a0-4f1d-b707-817ffc27cf2b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:12.829203 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-dc3906ff-15a0-4f1d-b707-817ffc27cf2b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] [instance: 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:12.836481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-dc3906ff-15a0-4f1d-b707-817ffc27cf2b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:12.837316 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-dc3906ff-15a0-4f1d-b707-817ffc27cf2b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:12.838413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-dc3906ff-15a0-4f1d-b707-817ffc27cf2b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:12.839375 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-dc3906ff-15a0-4f1d-b707-817ffc27cf2b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:12.857394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-dc3906ff-15a0-4f1d-b707-817ffc27cf2b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] HTTP exception thrown: Instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 could not be found. Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-dc3906ff-15a0-4f1d-b707-817ffc27cf2b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Request method failure captured: Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 HTTP/1.1 Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxZJTqH2tvjPaOfLf-GjKi9DdpfIw9vV-Dj8yIkT7Rz3rbj4seroxoGaC5amp93DC0XDdTji9E52xtlJmjDKJNS6ZcOTzI7g0ybI49K_1pbrztUd9_A_fsQh8uT7czdbHN5L1S_Ro5cLnbwPwf9s-JIk1_jyoTpeaVfStvrpu_2Lhk Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: d2263cfc378b4967ab4d2817991874f5 Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:14:12.859046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:14:12.860545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d2263cfc378b4967ab4d2817991874f5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d2263cfc378b4967ab4d2817991874f5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d2263cfc378b4967ab4d2817991874f5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d2263cfc378b4967ab4d2817991874f5"}]}] Jun 06 13:14:12.860545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:14:12.860545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: d2263cfc378b4967ab4d2817991874f5 Jun 06 13:14:12.860545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-1216849386 Jun 06 13:14:12.860545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-ServerRescueNegativeTestJSON-1216849386-project Jun 06 13:14:12.860545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:14:12.860545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:14:12.860545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: e8410e3632ec4908824d336fff667da5 Jun 06 13:14:12.860545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-ServerRescueNegativeTestJSON-1216849386-project Jun 06 13:14:12.860545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:14:12.860545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 could not be found. Jun 06 13:14:12.860545 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '5c50c488-a0ae-4331-9dfe-5fb0b7ab5108'} Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 could not be found. Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:14:12.861430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 could not be found. Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 could not be found. Jun 06 13:14:12.862651 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:12.864716 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-dc3906ff-15a0-4f1d-b707-817ffc27cf2b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] Returning 404 to user: Instance 5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:14:12.864716 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-dc3906ff-15a0-4f1d-b707-817ffc27cf2b tempest-ServerRescueNegativeTestJSON-1216849386 tempest-ServerRescueNegativeTestJSON-1216849386-project] 10.222.0.13 "GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108" status: 404 len: 111 microversion: 2.1 time: 0.038556 Jun 06 13:14:12.864716 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 372/763] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:12 2022] GET /compute/v2.1/servers/5c50c488-a0ae-4331-9dfe-5fb0b7ab5108 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:14:13.230403 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-493213c8-ccda-43f7-a004-6184a351015e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:13.231086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-493213c8-ccda-43f7-a004-6184a351015e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:13.239909 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-493213c8-ccda-43f7-a004-6184a351015e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:13.240355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-493213c8-ccda-43f7-a004-6184a351015e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:13.241118 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-493213c8-ccda-43f7-a004-6184a351015e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:13.241694 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-493213c8-ccda-43f7-a004-6184a351015e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:13.297176 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-493213c8-ccda-43f7-a004-6184a351015e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:13.297278 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-493213c8-ccda-43f7-a004-6184a351015e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:13.297708 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-493213c8-ccda-43f7-a004-6184a351015e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lazy-loading 'fault' on Instance uuid d70800c6-f31a-4b07-9a99-98a2e5ff905c {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:14:13.341929 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-493213c8-ccda-43f7-a004-6184a351015e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:13.350574 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-493213c8-ccda-43f7-a004-6184a351015e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 200 len: 1331 microversion: 2.1 time: 0.124848 Jun 06 13:14:13.351160 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 392/764] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:13 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 1331 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:14.368876 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3a16d94e-c1e8-4b7b-bd19-abe7e0a80006 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:14.370958 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3a16d94e-c1e8-4b7b-bd19-abe7e0a80006 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:14.377745 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3a16d94e-c1e8-4b7b-bd19-abe7e0a80006 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:14.378195 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3a16d94e-c1e8-4b7b-bd19-abe7e0a80006 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:14.379128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3a16d94e-c1e8-4b7b-bd19-abe7e0a80006 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:14.379598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3a16d94e-c1e8-4b7b-bd19-abe7e0a80006 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:14.395067 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-3a16d94e-c1e8-4b7b-bd19-abe7e0a80006 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3a16d94e-c1e8-4b7b-bd19-abe7e0a80006 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c HTTP/1.1 Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:14:14.396966 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:14:14.398307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:14:14.398307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:14:14.398307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:14:14.398307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:14:14.398307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:14:14.398307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:14:14.398307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:14:14.398307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:14:14.398307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:14:14.398307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:14:14.398307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:14:14.398307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': 'd70800c6-f31a-4b07-9a99-98a2e5ff905c'} Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:14:14.399048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:14:14.400308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:14.404153 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3a16d94e-c1e8-4b7b-bd19-abe7e0a80006 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 404 to user: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:14:14.404153 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3a16d94e-c1e8-4b7b-bd19-abe7e0a80006 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 404 len: 111 microversion: 2.1 time: 0.033577 Jun 06 13:14:14.407767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 373/765] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:14 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 111 bytes in 43 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:14:14.408422 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-30e6505f-a26f-4ff4-8c86-4da38cb66f78 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '.version_select at 0x7f0ef6f79d30>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:14.494955 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-30e6505f-a26f-4ff4-8c86-4da38cb66f78 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-300745952" status: 202 len: 0 microversion: 2.1 time: 0.085452 Jun 06 13:14:14.494955 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 393/766] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Jun 6 13:14:14 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-300745952 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Jun 06 13:14:15.519972 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a1ab26ef-b82e-4562-93e8-d55400d54694 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Action: 'create', calling method: .version_select at 0x7f0efc0f5a60>, body: {"keypair": {"name": "tempest-keypair-1020361954", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBP8COtp55driRDreGBMXuwFAaa242oxR06xFV9kni8CdV+dshu4Vk4a5EW4KhhJXwzWLSfHr8jBJX+iHEgcoHCfBNRjnMMwrAGgAAHeBujZBdkU/NaRlvdlsw1KdvfkXLw=="}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:15.535975 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-a1ab26ef-b82e-4562-93e8-d55400d54694 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for project d6db503a0a1749789e92ed63f5a113b7. Resources: {'key_pairs'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:14:15.540014 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-a1ab26ef-b82e-4562-93e8-d55400d54694 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for user 9c620175b84d4cee9aef398864c03c8d and project d6db503a0a1749789e92ed63f5a113b7. Resources: {'key_pairs'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:14:15.632699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a1ab26ef-b82e-4562-93e8-d55400d54694 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.116558 Jun 06 13:14:15.633314 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 374/767] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 13:14:15 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:17.600849 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1717477944", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-182726226", "security_groups": [{"name": "tempest-secgroup-smoke-99823546"}], "block_device_mapping_v2": [{"uuid": "6f82f379-35ee-4be9-919c-cebd8eab42e6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ad4e33a2-2cb6-465f-b54a-3fcb95401137"}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:17.608569 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=94,nova_api:INSERT=3,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:17.748770 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] validate_networks() for [('ad4e33a2-2cb6-465f-b54a-3fcb95401137', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:14:18.400291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-1560886700", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "2e6b38e7-6e44-43bf-a66b-a75358de1034"}], "security_groups": [{"name": "tempest-securitygroup--1690577951"}], "key_name": "tempest-keypair-1020361954", "user_data": "}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:18.460033 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:14:18.460515 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:14:18.460984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:14:18.461379 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:14:18.461984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:14:18.472815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:18.473295 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:18.474094 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:18.474851 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:18.502402 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Getting quotas for project 332996ee21f54ef3b78907332f5decce. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:14:18.508057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Getting quotas for user bd78c278513540ecadfc1a0f90b9ab16 and project 332996ee21f54ef3b78907332f5decce. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:14:18.538043 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.network.neutron [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] validate_networks() for [('2e6b38e7-6e44-43bf-a66b-a75358de1034', None, None, None, None, None)] {{(pid=118134) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:14:18.571295 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:14:18.574184 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6f82f379-35ee-4be9-919c-cebd8eab42e6',volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:14:19.025167 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Flavor limits 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:14:19.025656 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Image limits 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:14:19.026306 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Flavor pref 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:14:19.026710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Image pref 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:14:19.027116 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:14:19.036648 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:19.041581 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:19.041581 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:19.041581 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:19.055107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for project d6db503a0a1749789e92ed63f5a113b7. Resources: {'cores', 'ram', 'instances'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:14:19.059653 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Getting quotas for user 9c620175b84d4cee9aef398864c03c8d and project d6db503a0a1749789e92ed63f5a113b7. Resources: {'cores', 'ram', 'instances'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:14:19.073344 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Going to run 1 instances... {{(pid=118134) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:14:19.075743 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:14:19.078494 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1cc998fb-3f0c-4dee-8719-14196c96d675 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.484022 Jun 06 13:14:19.084041 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 394/768] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:14:17 2022] POST /compute/v2.1/servers => generated 404 bytes in 1485 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:14:19.115939 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=96,nova_api:DELETE=1,nova_api:INSERT=2,nova_api:UPDATE=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:19.182462 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-55d87f4c-327e-42f1-ba36-0e8044d65fa5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.786649 Jun 06 13:14:19.183973 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 375/769] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:14:18 2022] POST /compute/v2.1/servers => generated 402 bytes in 789 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 13:14:19.193064 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-83f6437b-6f06-4863-b54d-74dedc8def9a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:19.193787 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-83f6437b-6f06-4863-b54d-74dedc8def9a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:19.267365 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-83f6437b-6f06-4863-b54d-74dedc8def9a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:19.274526 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-83f6437b-6f06-4863-b54d-74dedc8def9a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1094 microversion: 2.1 time: 0.089172 Jun 06 13:14:19.275089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 376/770] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:19 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1094 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:19.317586 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5f0a25ea-5b10-4d91-8ba4-1550122a2857 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:19.318125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5f0a25ea-5b10-4d91-8ba4-1550122a2857 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:19.326572 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5f0a25ea-5b10-4d91-8ba4-1550122a2857 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:19.327009 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5f0a25ea-5b10-4d91-8ba4-1550122a2857 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:19.327807 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5f0a25ea-5b10-4d91-8ba4-1550122a2857 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:19.328235 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5f0a25ea-5b10-4d91-8ba4-1550122a2857 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:19.353288 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5f0a25ea-5b10-4d91-8ba4-1550122a2857 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/ips" status: 200 len: 152 microversion: 2.20 time: 0.272708 Jun 06 13:14:19.359181 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 395/771] 10.222.0.13 () {60 vars in 1288 bytes} [Mon Jun 6 13:14:19 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/ips => generated 152 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:14:19.363782 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-90daff82-8f49-4ab2-bb23-e019a42b18b6 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Action: 'create', calling method: .version_select at 0x7f0efc125700>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-487294822", "metadata": {"Type": "work"}}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:19.363926 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-90cb146c-2473-4caf-be1d-d4e083f20941 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:19.364513 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-90cb146c-2473-4caf-be1d-d4e083f20941 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-90daff82-8f49-4ab2-bb23-e019a42b18b6 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Request method failure captured: Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 121 Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinf2rFiuUetnSebxM8SUjyY3OSgTjHm7A5PpBTIiSy81ejT67-nWVctHdBEKiMHxiQ0_LCQU8K1BhOGvUgjGebo-sENfGOHvi5xZdTLJynsILtOU1vIAa58hliS2u5vdQxsY8pDUosr7A1CBKBVseVLM3cuOftZn112S81uTtWfGywi8 Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 013fab1304b545b69b798225bc6fb89b Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:14:19.381831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:14:19.383758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_013fab1304b545b69b798225bc6fb89b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/013fab1304b545b69b798225bc6fb89b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/013fab1304b545b69b798225bc6fb89b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/013fab1304b545b69b798225bc6fb89b"}]}] Jun 06 13:14:19.383758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.383758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 013fab1304b545b69b798225bc6fb89b Jun 06 13:14:19.383758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.383758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-VolumesNegativeTest-965058728-project Jun 06 13:14:19.383758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:14:19.383758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:14:19.383758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 08906cf78f47409c927d26da11d03c6f Jun 06 13:14:19.383758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-VolumesNegativeTest-965058728-project Jun 06 13:14:19.383758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Jun 06 13:14:19.383758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-487294822", "metadata": {"Type": "work"}}} Jun 06 13:14:19.383758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: Jun 06 13:14:19.383758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-487294822', 'metadata': {'Type': 'work'}}}} Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise error Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi '#$%' Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:14:19.384767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 13:14:19.387071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 13:14:19.388613 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Jun 06 13:14:19.388613 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.389511 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-90daff82-8f49-4ab2-bb23-e019a42b18b6 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:14:19.390470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-90daff82-8f49-4ab2-bb23-e019a42b18b6 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.112256 Jun 06 13:14:19.391203 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 377/772] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jun 6 13:14:19 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 113 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 13:14:19.402786 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b5aa25bd-7dbd-481e-9ee5-03a9f0fd01f1 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Action: 'create', calling method: .version_select at 0x7f0efc04a670>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2018046913", "metadata": {"Type": "work"}}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b5aa25bd-7dbd-481e-9ee5-03a9f0fd01f1 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Request method failure captured: Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 120 Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinf2rFiuUetnSebxM8SUjyY3OSgTjHm7A5PpBTIiSy81ejT67-nWVctHdBEKiMHxiQ0_LCQU8K1BhOGvUgjGebo-sENfGOHvi5xZdTLJynsILtOU1vIAa58hliS2u5vdQxsY8pDUosr7A1CBKBVseVLM3cuOftZn112S81uTtWfGywi8 Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 013fab1304b545b69b798225bc6fb89b Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:14:19.405899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:14:19.407518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_013fab1304b545b69b798225bc6fb89b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/013fab1304b545b69b798225bc6fb89b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/013fab1304b545b69b798225bc6fb89b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/013fab1304b545b69b798225bc6fb89b"}]}] Jun 06 13:14:19.407518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.407518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 013fab1304b545b69b798225bc6fb89b Jun 06 13:14:19.407518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.407518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-VolumesNegativeTest-965058728-project Jun 06 13:14:19.407518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:14:19.407518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:14:19.407518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 08906cf78f47409c927d26da11d03c6f Jun 06 13:14:19.407518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-VolumesNegativeTest-965058728-project Jun 06 13:14:19.407518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Jun 06 13:14:19.407518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-2018046913", "metadata": {"Type": "work"}}} Jun 06 13:14:19.407518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: Jun 06 13:14:19.407518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-2018046913', 'metadata': {'Type': 'work'}}}} Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise error Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi '0' Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:14:19.408846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 13:14:19.410562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 13:14:19.412117 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Jun 06 13:14:19.412117 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.412117 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b5aa25bd-7dbd-481e-9ee5-03a9f0fd01f1 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:14:19.412117 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b5aa25bd-7dbd-481e-9ee5-03a9f0fd01f1 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.012541 Jun 06 13:14:19.415920 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 378/773] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jun 6 13:14:19 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 20 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Jun 06 13:14:19.422997 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-030b3a70-b94d-4693-9174-5f08b42821f9 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Action: 'create', calling method: .version_select at 0x7f0efc0c3940>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-252343816", "metadata": {"Type": "work"}}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-030b3a70-b94d-4693-9174-5f08b42821f9 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Request method failure captured: Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 118 Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinf2rFiuUetnSebxM8SUjyY3OSgTjHm7A5PpBTIiSy81ejT67-nWVctHdBEKiMHxiQ0_LCQU8K1BhOGvUgjGebo-sENfGOHvi5xZdTLJynsILtOU1vIAa58hliS2u5vdQxsY8pDUosr7A1CBKBVseVLM3cuOftZn112S81uTtWfGywi8 Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 013fab1304b545b69b798225bc6fb89b Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:14:19.433932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:14:19.436670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_013fab1304b545b69b798225bc6fb89b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/013fab1304b545b69b798225bc6fb89b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/013fab1304b545b69b798225bc6fb89b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/013fab1304b545b69b798225bc6fb89b"}]}] Jun 06 13:14:19.436670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.436670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 013fab1304b545b69b798225bc6fb89b Jun 06 13:14:19.436670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.436670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-VolumesNegativeTest-965058728-project Jun 06 13:14:19.436670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:14:19.436670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:14:19.436670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 08906cf78f47409c927d26da11d03c6f Jun 06 13:14:19.436670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-VolumesNegativeTest-965058728-project Jun 06 13:14:19.436670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Jun 06 13:14:19.436670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-252343816", "metadata": {"Type": "work"}}} Jun 06 13:14:19.436670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: Jun 06 13:14:19.436670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-252343816', 'metadata': {'Type': 'work'}}}} Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 279, in validate Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/lib/python3/dist-packages/jsonschema/validators.py", line 353, in validate Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise error Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi On instance['volume']: Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi '' Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:14:19.437641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 308, in validate Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Jun 06 13:14:19.439229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Jun 06 13:14:19.440635 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Jun 06 13:14:19.440635 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.440635 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-030b3a70-b94d-4693-9174-5f08b42821f9 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:14:19.440635 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-030b3a70-b94d-4693-9174-5f08b42821f9 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009111 Jun 06 13:14:19.440635 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 379/774] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jun 6 13:14:19 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Jun 06 13:14:19.440971 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-90cb146c-2473-4caf-be1d-d4e083f20941 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:19.440971 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-90cb146c-2473-4caf-be1d-d4e083f20941 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1242 microversion: 2.1 time: 0.079393 Jun 06 13:14:19.440971 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 396/775] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:19 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1242 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:19.445058 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fa3ffa57-907f-402e-877a-df673b6de034 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Calling method '.version_select at 0x7f0efc125820>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:19.475844 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-fa3ffa57-907f-402e-877a-df673b6de034 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] HTTP exception thrown: Volume tempest-invalid-956253319 could not be found. Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fa3ffa57-907f-402e-877a-df673b6de034 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Request method failure captured: Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-956253319 HTTP/1.1 Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinf2rFiuUetnSebxM8SUjyY3OSgTjHm7A5PpBTIiSy81ejT67-nWVctHdBEKiMHxiQ0_LCQU8K1BhOGvUgjGebo-sENfGOHvi5xZdTLJynsILtOU1vIAa58hliS2u5vdQxsY8pDUosr7A1CBKBVseVLM3cuOftZn112S81uTtWfGywi8 Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 013fab1304b545b69b798225bc6fb89b Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:14:19.477775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:14:19.479387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_013fab1304b545b69b798225bc6fb89b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/013fab1304b545b69b798225bc6fb89b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/013fab1304b545b69b798225bc6fb89b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/013fab1304b545b69b798225bc6fb89b"}]}] Jun 06 13:14:19.479387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.479387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 013fab1304b545b69b798225bc6fb89b Jun 06 13:14:19.479387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.479387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-VolumesNegativeTest-965058728-project Jun 06 13:14:19.479387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:14:19.479387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:14:19.479387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 08906cf78f47409c927d26da11d03c6f Jun 06 13:14:19.479387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-VolumesNegativeTest-965058728-project Jun 06 13:14:19.479387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: Jun 06 13:14:19.479387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Volume tempest-invalid-956253319 could not be found. Jun 06 13:14:19.479387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': 'tempest-invalid-956253319'} Jun 06 13:14:19.479387 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-956253319 could not be found. (HTTP 404) (Request-ID: req-f455f842-b1f3-4eee-a625-c702d77ff38b) Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.480551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 13:14:19.481913 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-956253319 could not be found. Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:14:19.483331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-956253319 could not be found. Jun 06 13:14:19.484784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.484784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.484784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.484784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.484784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:19.484784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:19.484784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:14:19.484784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:14:19.484784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-956253319 could not be found. Jun 06 13:14:19.484784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.484784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fa3ffa57-907f-402e-877a-df673b6de034 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Returning 404 to user: Volume tempest-invalid-956253319 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:14:19.484784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-fa3ffa57-907f-402e-877a-df673b6de034 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/tempest-invalid-956253319" status: 404 len: 98 microversion: 2.1 time: 0.040761 Jun 06 13:14:19.487329 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 380/776] 10.222.0.13 () {58 vars in 1214 bytes} [Mon Jun 6 13:14:19 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-956253319 => generated 98 bytes in 50 msecs (HTTP/1.1 404) 9 headers in 378 bytes (1 switches on core 0) Jun 06 13:14:19.498371 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-00504daa-c37b-493e-9007-60fe575c1916 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.005409 Jun 06 13:14:19.499453 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 397/777] 10.222.0.13 () {58 vars in 1139 bytes} [Mon Jun 6 13:14:19 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 8 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 06 13:14:19.509598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6a42db19-d82e-416e-a840-f956aebc6409 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004666 Jun 06 13:14:19.510690 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 381/778] 10.222.0.13 () {58 vars in 1136 bytes} [Mon Jun 6 13:14:19 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Jun 06 13:14:19.519829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e4b95c71-d863-4d63-bdb6-4cc2b8bf34a3 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Calling method '.version_select at 0x7f0ef6f79820>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:19.547707 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-e4b95c71-d863-4d63-bdb6-4cc2b8bf34a3 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] HTTP exception thrown: Volume 95e9ff67-101b-4db7-81f1-b14db027e22b could not be found. Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e4b95c71-d863-4d63-bdb6-4cc2b8bf34a3 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Request method failure captured: Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/os-volumes/95e9ff67-101b-4db7-81f1-b14db027e22b HTTP/1.1 Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinf2rFiuUetnSebxM8SUjyY3OSgTjHm7A5PpBTIiSy81ejT67-nWVctHdBEKiMHxiQ0_LCQU8K1BhOGvUgjGebo-sENfGOHvi5xZdTLJynsILtOU1vIAa58hliS2u5vdQxsY8pDUosr7A1CBKBVseVLM3cuOftZn112S81uTtWfGywi8 Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: 013fab1304b545b69b798225bc6fb89b Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:14:19.549829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:14:19.551369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_013fab1304b545b69b798225bc6fb89b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/013fab1304b545b69b798225bc6fb89b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/013fab1304b545b69b798225bc6fb89b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/013fab1304b545b69b798225bc6fb89b"}]}] Jun 06 13:14:19.551369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.551369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 013fab1304b545b69b798225bc6fb89b Jun 06 13:14:19.551369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.551369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-VolumesNegativeTest-965058728-project Jun 06 13:14:19.551369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:14:19.551369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:14:19.551369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 08906cf78f47409c927d26da11d03c6f Jun 06 13:14:19.551369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-VolumesNegativeTest-965058728-project Jun 06 13:14:19.551369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: Jun 06 13:14:19.551369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Volume 95e9ff67-101b-4db7-81f1-b14db027e22b could not be found. Jun 06 13:14:19.551369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': '95e9ff67-101b-4db7-81f1-b14db027e22b'} Jun 06 13:14:19.551369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 95e9ff67-101b-4db7-81f1-b14db027e22b could not be found. (HTTP 404) (Request-ID: req-8053a985-7b7c-43b5-b5f7-cf093d97a841) Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.552356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._delete(loc) Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Jun 06 13:14:19.553711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 95e9ff67-101b-4db7-81f1-b14db027e22b could not be found. Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Jun 06 13:14:19.555137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 95e9ff67-101b-4db7-81f1-b14db027e22b could not be found. Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 95e9ff67-101b-4db7-81f1-b14db027e22b could not be found. Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e4b95c71-d863-4d63-bdb6-4cc2b8bf34a3 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Returning 404 to user: Volume 95e9ff67-101b-4db7-81f1-b14db027e22b could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e4b95c71-d863-4d63-bdb6-4cc2b8bf34a3 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/95e9ff67-101b-4db7-81f1-b14db027e22b" status: 404 len: 109 microversion: 2.1 time: 0.035321 Jun 06 13:14:19.556577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 398/779] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 13:14:19 2022] DELETE /compute/v2.1/os-volumes/95e9ff67-101b-4db7-81f1-b14db027e22b => generated 109 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 13:14:19.562369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ffae4058-2bf0-48c6-8259-ad0dfbf57678 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Calling method '.version_select at 0x7f0efc1253a0>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:19.591105 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-ffae4058-2bf0-48c6-8259-ad0dfbf57678 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] HTTP exception thrown: Volume e0280f92-e78f-4951-8784-618c3a4b411d could not be found. Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ffae4058-2bf0-48c6-8259-ad0dfbf57678 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Request method failure captured: Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/os-volumes/e0280f92-e78f-4951-8784-618c3a4b411d HTTP/1.1 Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinf2rFiuUetnSebxM8SUjyY3OSgTjHm7A5PpBTIiSy81ejT67-nWVctHdBEKiMHxiQ0_LCQU8K1BhOGvUgjGebo-sENfGOHvi5xZdTLJynsILtOU1vIAa58hliS2u5vdQxsY8pDUosr7A1CBKBVseVLM3cuOftZn112S81uTtWfGywi8 Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 013fab1304b545b69b798225bc6fb89b Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:14:19.593134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:14:19.594699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_013fab1304b545b69b798225bc6fb89b", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/013fab1304b545b69b798225bc6fb89b"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/013fab1304b545b69b798225bc6fb89b"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/013fab1304b545b69b798225bc6fb89b"}]}] Jun 06 13:14:19.594699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.594699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 013fab1304b545b69b798225bc6fb89b Jun 06 13:14:19.594699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-VolumesNegativeTest-965058728 Jun 06 13:14:19.594699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-VolumesNegativeTest-965058728-project Jun 06 13:14:19.594699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:14:19.594699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:14:19.594699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 08906cf78f47409c927d26da11d03c6f Jun 06 13:14:19.594699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-VolumesNegativeTest-965058728-project Jun 06 13:14:19.594699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: Jun 06 13:14:19.594699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Volume e0280f92-e78f-4951-8784-618c3a4b411d could not be found. Jun 06 13:14:19.594699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': 'e0280f92-e78f-4951-8784-618c3a4b411d'} Jun 06 13:14:19.594699 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e0280f92-e78f-4951-8784-618c3a4b411d could not be found. (HTTP 404) (Request-ID: req-3b717a88-203d-4267-ae6e-9e79f3c49932) Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.595685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 13:14:19.597114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e0280f92-e78f-4951-8784-618c3a4b411d could not be found. Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 13:14:19.598374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:14:19.599772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e0280f92-e78f-4951-8784-618c3a4b411d could not be found. Jun 06 13:14:19.599772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.599772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:19.599772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.599772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:19.599772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:19.599772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:19.599772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:14:19.599772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:14:19.599772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e0280f92-e78f-4951-8784-618c3a4b411d could not be found. Jun 06 13:14:19.599772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:14:19.599772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ffae4058-2bf0-48c6-8259-ad0dfbf57678 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] Returning 404 to user: Volume e0280f92-e78f-4951-8784-618c3a4b411d could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:14:19.599772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ffae4058-2bf0-48c6-8259-ad0dfbf57678 tempest-VolumesNegativeTest-965058728 tempest-VolumesNegativeTest-965058728-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/e0280f92-e78f-4951-8784-618c3a4b411d" status: 404 len: 109 microversion: 2.1 time: 0.036146 Jun 06 13:14:19.601866 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 382/780] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:14:19 2022] GET /compute/v2.1/os-volumes/e0280f92-e78f-4951-8784-618c3a4b411d => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:14:20.296141 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9003962a-d463-4684-8d0c-501e93642838 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:20.296718 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9003962a-d463-4684-8d0c-501e93642838 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:20.302666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9003962a-d463-4684-8d0c-501e93642838 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:20.303158 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9003962a-d463-4684-8d0c-501e93642838 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:20.303961 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9003962a-d463-4684-8d0c-501e93642838 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:20.304402 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9003962a-d463-4684-8d0c-501e93642838 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:20.365382 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9003962a-d463-4684-8d0c-501e93642838 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:20.373315 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9003962a-d463-4684-8d0c-501e93642838 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1144 microversion: 2.1 time: 0.084039 Jun 06 13:14:20.373884 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 399/781] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:20 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1144 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:14:20.458660 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a8c72b75-13dd-4749-aec7-ac13d4423bac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:20.459238 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a8c72b75-13dd-4749-aec7-ac13d4423bac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:20.466755 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a8c72b75-13dd-4749-aec7-ac13d4423bac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:20.467204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a8c72b75-13dd-4749-aec7-ac13d4423bac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:20.467993 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a8c72b75-13dd-4749-aec7-ac13d4423bac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:20.468588 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a8c72b75-13dd-4749-aec7-ac13d4423bac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:20.546040 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a8c72b75-13dd-4749-aec7-ac13d4423bac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:20.553954 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a8c72b75-13dd-4749-aec7-ac13d4423bac tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1246 microversion: 2.1 time: 0.100698 Jun 06 13:14:20.554810 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 383/782] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:20 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1246 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:21.390374 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-27bfd3bb-9373-4926-a714-39e7e439f1ca tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:21.390984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-27bfd3bb-9373-4926-a714-39e7e439f1ca tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:21.397545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27bfd3bb-9373-4926-a714-39e7e439f1ca tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:21.397988 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27bfd3bb-9373-4926-a714-39e7e439f1ca tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:21.398761 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27bfd3bb-9373-4926-a714-39e7e439f1ca tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:21.399228 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27bfd3bb-9373-4926-a714-39e7e439f1ca tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:21.464999 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-27bfd3bb-9373-4926-a714-39e7e439f1ca tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:21.472501 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-27bfd3bb-9373-4926-a714-39e7e439f1ca tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1192 microversion: 2.1 time: 0.086176 Jun 06 13:14:21.473070 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 400/783] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:21 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1192 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:21.571253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2b367f8e-c845-4518-a51e-718bee576d5e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:21.572174 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2b367f8e-c845-4518-a51e-718bee576d5e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:21.580392 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b367f8e-c845-4518-a51e-718bee576d5e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:21.581067 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b367f8e-c845-4518-a51e-718bee576d5e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:21.582089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b367f8e-c845-4518-a51e-718bee576d5e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:21.582538 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b367f8e-c845-4518-a51e-718bee576d5e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:21.601483 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:21.659938 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-2b367f8e-c845-4518-a51e-718bee576d5e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:21.667875 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f8b8a5c9-2fe2-4a44-9295-a4825b178dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:21.668767 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f8b8a5c9-2fe2-4a44-9295-a4825b178dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:21.674743 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2b367f8e-c845-4518-a51e-718bee576d5e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1302 microversion: 2.1 time: 0.107393 Jun 06 13:14:21.675988 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 384/784] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:21 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1302 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:21.682881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f8b8a5c9-2fe2-4a44-9295-a4825b178dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:21.683682 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f8b8a5c9-2fe2-4a44-9295-a4825b178dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:21.684816 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f8b8a5c9-2fe2-4a44-9295-a4825b178dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:21.685471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f8b8a5c9-2fe2-4a44-9295-a4825b178dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:21.718866 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-f8b8a5c9-2fe2-4a44-9295-a4825b178dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lazy-loading 'flavor' on Instance uuid 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:14:22.316873 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f8b8a5c9-2fe2-4a44-9295-a4825b178dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "POST /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/action" status: 202 len: 0 microversion: 2.20 time: 0.653941 Jun 06 13:14:22.319685 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 401/785] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jun 6 13:14:21 2022] POST /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/action => generated 0 bytes in 655 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:14:22.327607 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ece7ac4b-f51e-4c55-ab28-b86d772c721f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:22.328220 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ece7ac4b-f51e-4c55-ab28-b86d772c721f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:22.335094 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ece7ac4b-f51e-4c55-ab28-b86d772c721f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:22.335563 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ece7ac4b-f51e-4c55-ab28-b86d772c721f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:22.336328 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ece7ac4b-f51e-4c55-ab28-b86d772c721f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:22.336766 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ece7ac4b-f51e-4c55-ab28-b86d772c721f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:22.498861 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-142dc398-b0f4-4c66-a834-fc0bb264adf2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:22.499597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-142dc398-b0f4-4c66-a834-fc0bb264adf2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:22.507619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-142dc398-b0f4-4c66-a834-fc0bb264adf2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:22.508077 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-142dc398-b0f4-4c66-a834-fc0bb264adf2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:22.509123 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-142dc398-b0f4-4c66-a834-fc0bb264adf2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:22.509559 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-142dc398-b0f4-4c66-a834-fc0bb264adf2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:22.625190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-142dc398-b0f4-4c66-a834-fc0bb264adf2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:22.635133 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-142dc398-b0f4-4c66-a834-fc0bb264adf2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1210 microversion: 2.1 time: 0.142639 Jun 06 13:14:22.638739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 402/786] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:22 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1210 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:14:22.643971 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ece7ac4b-f51e-4c55-ab28-b86d772c721f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:22.658702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ece7ac4b-f51e-4c55-ab28-b86d772c721f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:22.662378 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ece7ac4b-f51e-4c55-ab28-b86d772c721f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:22.664186 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ece7ac4b-f51e-4c55-ab28-b86d772c721f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.342336 Jun 06 13:14:22.668697 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 385/787] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:22 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:22.693783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8b620936-1f2b-4411-9a33-4e78da39ca77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:22.694540 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8b620936-1f2b-4411-9a33-4e78da39ca77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:22.703074 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8b620936-1f2b-4411-9a33-4e78da39ca77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:22.703718 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8b620936-1f2b-4411-9a33-4e78da39ca77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:22.704570 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8b620936-1f2b-4411-9a33-4e78da39ca77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:22.705082 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8b620936-1f2b-4411-9a33-4e78da39ca77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:22.723777 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:22.972588 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8b620936-1f2b-4411-9a33-4e78da39ca77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:22.981748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8b620936-1f2b-4411-9a33-4e78da39ca77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1368 microversion: 2.1 time: 0.292071 Jun 06 13:14:22.982333 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 403/788] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:22 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1368 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:23.655901 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f68ad8f7-a17e-48b8-a4e7-69398703b289 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:23.656509 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f68ad8f7-a17e-48b8-a4e7-69398703b289 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:23.663140 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f68ad8f7-a17e-48b8-a4e7-69398703b289 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:23.663598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f68ad8f7-a17e-48b8-a4e7-69398703b289 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:23.664367 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f68ad8f7-a17e-48b8-a4e7-69398703b289 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:23.664849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f68ad8f7-a17e-48b8-a4e7-69398703b289 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:23.685411 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2b2d66fd-d977-4d4e-8f68-087f2a58d4d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:23.686148 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2b2d66fd-d977-4d4e-8f68-087f2a58d4d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:23.693278 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b2d66fd-d977-4d4e-8f68-087f2a58d4d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:23.693988 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b2d66fd-d977-4d4e-8f68-087f2a58d4d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:23.694733 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b2d66fd-d977-4d4e-8f68-087f2a58d4d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:23.695170 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b2d66fd-d977-4d4e-8f68-087f2a58d4d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:23.999226 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f68ad8f7-a17e-48b8-a4e7-69398703b289 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:24.011969 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f68ad8f7-a17e-48b8-a4e7-69398703b289 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1264 microversion: 2.1 time: 0.358122 Jun 06 13:14:24.012719 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 386/789] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:23 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1264 bytes in 363 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:14:24.027114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-ec9c1532-b8cf-4d35-92b8-2e6e7858252d req-f9106129-9f98-4791-9eb8-9e7ff0425db8 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6f51ea-9ed2-4db7-84ac-f8c4e438741d", "tag": "7c1f42d9-3d50-49f7-bf0a-b51558b54975"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:24.038772 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2b2d66fd-d977-4d4e-8f68-087f2a58d4d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:24.050314 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-ec9c1532-b8cf-4d35-92b8-2e6e7858252d req-f9106129-9f98-4791-9eb8-9e7ff0425db8 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:24.050934 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-ec9c1532-b8cf-4d35-92b8-2e6e7858252d req-f9106129-9f98-4791-9eb8-9e7ff0425db8 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:24.055595 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2b2d66fd-d977-4d4e-8f68-087f2a58d4d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:24.055595 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2b2d66fd-d977-4d4e-8f68-087f2a58d4d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:24.057118 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2b2d66fd-d977-4d4e-8f68-087f2a58d4d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.375057 Jun 06 13:14:24.059972 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 404/790] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:23 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:14:24.064493 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-ec9c1532-b8cf-4d35-92b8-2e6e7858252d req-f9106129-9f98-4791-9eb8-9e7ff0425db8 service nova] Creating event network-changed:7c1f42d9-3d50-49f7-bf0a-b51558b54975 for instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d on hv-cinder-75510 Jun 06 13:14:24.069703 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-ec9c1532-b8cf-4d35-92b8-2e6e7858252d req-f9106129-9f98-4791-9eb8-9e7ff0425db8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.055441 Jun 06 13:14:24.070819 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 387/791] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:24.077101 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8823a507-1e92-4fe7-8b80-864231b15c41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:24.077922 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8823a507-1e92-4fe7-8b80-864231b15c41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:24.084255 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8823a507-1e92-4fe7-8b80-864231b15c41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:24.087496 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8823a507-1e92-4fe7-8b80-864231b15c41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:24.087496 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8823a507-1e92-4fe7-8b80-864231b15c41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:24.087496 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8823a507-1e92-4fe7-8b80-864231b15c41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:24.255983 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8823a507-1e92-4fe7-8b80-864231b15c41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:24.263580 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8823a507-1e92-4fe7-8b80-864231b15c41 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1368 microversion: 2.1 time: 0.202047 Jun 06 13:14:24.264152 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 405/792] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:24 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1368 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:24.347971 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-450f05ab-54fc-4c14-9d74-0d80f26b9686 req-fd94abc0-85fd-4ba6-a7db-0597a5f34dc0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "787b0a77-8cba-4834-98e8-4524ac3e03d7", "tag": "0bb1b662-7ea0-4f9a-b1f3-e9c46704c25e"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:24.360145 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-450f05ab-54fc-4c14-9d74-0d80f26b9686 req-fd94abc0-85fd-4ba6-a7db-0597a5f34dc0 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:24.361159 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-450f05ab-54fc-4c14-9d74-0d80f26b9686 req-fd94abc0-85fd-4ba6-a7db-0597a5f34dc0 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:24.373563 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-450f05ab-54fc-4c14-9d74-0d80f26b9686 req-fd94abc0-85fd-4ba6-a7db-0597a5f34dc0 service nova] Creating event network-changed:0bb1b662-7ea0-4f9a-b1f3-e9c46704c25e for instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 on hv-cinder-75510 Jun 06 13:14:24.378548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-450f05ab-54fc-4c14-9d74-0d80f26b9686 req-fd94abc0-85fd-4ba6-a7db-0597a5f34dc0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034484 Jun 06 13:14:24.379227 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 388/793] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:25.029241 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-648f901e-6ca4-413c-967e-258253e4008b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:25.029837 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-648f901e-6ca4-413c-967e-258253e4008b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:25.036956 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-648f901e-6ca4-413c-967e-258253e4008b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:25.037395 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-648f901e-6ca4-413c-967e-258253e4008b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:25.038148 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-648f901e-6ca4-413c-967e-258253e4008b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:25.038579 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-648f901e-6ca4-413c-967e-258253e4008b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:25.080680 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cc21dc0c-3c42-4219-b870-248a1adfa17f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:25.081978 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-cc21dc0c-3c42-4219-b870-248a1adfa17f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:25.088637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cc21dc0c-3c42-4219-b870-248a1adfa17f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:25.089328 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cc21dc0c-3c42-4219-b870-248a1adfa17f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:25.093210 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cc21dc0c-3c42-4219-b870-248a1adfa17f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:25.093663 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cc21dc0c-3c42-4219-b870-248a1adfa17f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:25.232427 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-648f901e-6ca4-413c-967e-258253e4008b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:25.241303 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-648f901e-6ca4-413c-967e-258253e4008b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1264 microversion: 2.1 time: 0.216120 Jun 06 13:14:25.241877 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 406/794] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:25 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1264 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:25.269437 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cc21dc0c-3c42-4219-b870-248a1adfa17f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:25.277659 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cc21dc0c-3c42-4219-b870-248a1adfa17f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:25.279176 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cc21dc0c-3c42-4219-b870-248a1adfa17f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:25.280502 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cc21dc0c-3c42-4219-b870-248a1adfa17f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.206613 Jun 06 13:14:25.281048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 389/795] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:25 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:14:25.281185 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-630cac5a-4fd3-4233-a047-07cbcdacaa30 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:25.281797 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-630cac5a-4fd3-4233-a047-07cbcdacaa30 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:25.287892 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-630cac5a-4fd3-4233-a047-07cbcdacaa30 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:25.288335 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-630cac5a-4fd3-4233-a047-07cbcdacaa30 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:25.289086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-630cac5a-4fd3-4233-a047-07cbcdacaa30 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:25.289512 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-630cac5a-4fd3-4233-a047-07cbcdacaa30 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:25.521095 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-630cac5a-4fd3-4233-a047-07cbcdacaa30 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:25.531663 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-630cac5a-4fd3-4233-a047-07cbcdacaa30 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1368 microversion: 2.1 time: 0.254476 Jun 06 13:14:25.532759 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 407/796] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:25 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1368 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:14:26.259256 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-44796f2c-6026-4670-9977-a8c7497512d4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:26.260117 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-44796f2c-6026-4670-9977-a8c7497512d4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:26.267383 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-44796f2c-6026-4670-9977-a8c7497512d4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:26.267946 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-44796f2c-6026-4670-9977-a8c7497512d4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:26.268727 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-44796f2c-6026-4670-9977-a8c7497512d4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:26.269165 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-44796f2c-6026-4670-9977-a8c7497512d4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:26.298926 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c345d697-1538-47fc-ba24-c743b862f438 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:26.299659 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c345d697-1538-47fc-ba24-c743b862f438 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:26.306204 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c345d697-1538-47fc-ba24-c743b862f438 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:26.306650 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c345d697-1538-47fc-ba24-c743b862f438 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:26.307434 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c345d697-1538-47fc-ba24-c743b862f438 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:26.307911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c345d697-1538-47fc-ba24-c743b862f438 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:26.457091 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-44796f2c-6026-4670-9977-a8c7497512d4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:26.465823 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-44796f2c-6026-4670-9977-a8c7497512d4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1264 microversion: 2.1 time: 0.210311 Jun 06 13:14:26.466396 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 390/797] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:26 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1264 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:26.483432 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c345d697-1538-47fc-ba24-c743b862f438 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:26.491660 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c345d697-1538-47fc-ba24-c743b862f438 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:26.493171 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c345d697-1538-47fc-ba24-c743b862f438 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:26.494338 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c345d697-1538-47fc-ba24-c743b862f438 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.199758 Jun 06 13:14:26.494888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 408/798] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:26 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:26.549289 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1c72bf90-0c62-4a75-8ff3-c6e81c11dba6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:26.549910 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1c72bf90-0c62-4a75-8ff3-c6e81c11dba6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:26.555924 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1c72bf90-0c62-4a75-8ff3-c6e81c11dba6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:26.556380 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1c72bf90-0c62-4a75-8ff3-c6e81c11dba6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:26.557151 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1c72bf90-0c62-4a75-8ff3-c6e81c11dba6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:26.557588 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1c72bf90-0c62-4a75-8ff3-c6e81c11dba6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:26.695923 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1c72bf90-0c62-4a75-8ff3-c6e81c11dba6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:26.705458 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1c72bf90-0c62-4a75-8ff3-c6e81c11dba6 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1368 microversion: 2.1 time: 0.160038 Jun 06 13:14:26.706523 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 391/799] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:26 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1368 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:27.482396 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-84b76d7f-bf75-4b72-bc0c-f875d33b86f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:27.482995 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-84b76d7f-bf75-4b72-bc0c-f875d33b86f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:27.489393 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-84b76d7f-bf75-4b72-bc0c-f875d33b86f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:27.489835 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-84b76d7f-bf75-4b72-bc0c-f875d33b86f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:27.490589 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-84b76d7f-bf75-4b72-bc0c-f875d33b86f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:27.491020 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-84b76d7f-bf75-4b72-bc0c-f875d33b86f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:27.517179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-736a6b18-8bcb-4108-9dcd-22c8a3b99c99 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:27.518118 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-736a6b18-8bcb-4108-9dcd-22c8a3b99c99 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:27.524385 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-736a6b18-8bcb-4108-9dcd-22c8a3b99c99 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:27.524824 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-736a6b18-8bcb-4108-9dcd-22c8a3b99c99 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:27.525583 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-736a6b18-8bcb-4108-9dcd-22c8a3b99c99 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:27.526009 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-736a6b18-8bcb-4108-9dcd-22c8a3b99c99 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:27.759702 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-84b76d7f-bf75-4b72-bc0c-f875d33b86f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:27.771464 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-736a6b18-8bcb-4108-9dcd-22c8a3b99c99 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:27.780205 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-736a6b18-8bcb-4108-9dcd-22c8a3b99c99 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:27.781178 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-84b76d7f-bf75-4b72-bc0c-f875d33b86f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1264 microversion: 2.1 time: 0.302834 Jun 06 13:14:27.781770 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 409/800] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:27 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1264 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:27.781899 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-736a6b18-8bcb-4108-9dcd-22c8a3b99c99 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:27.783202 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-736a6b18-8bcb-4108-9dcd-22c8a3b99c99 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.270398 Jun 06 13:14:27.784328 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 392/801] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:27 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 272 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:27.798937 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-31a98a2b-80d7-410d-b010-c6cad1f67ef8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:27.799574 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-31a98a2b-80d7-410d-b010-c6cad1f67ef8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:27.805473 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-31a98a2b-80d7-410d-b010-c6cad1f67ef8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:27.805917 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-31a98a2b-80d7-410d-b010-c6cad1f67ef8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:27.806702 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-31a98a2b-80d7-410d-b010-c6cad1f67ef8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:27.807137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-31a98a2b-80d7-410d-b010-c6cad1f67ef8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:28.168606 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-31a98a2b-80d7-410d-b010-c6cad1f67ef8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:28.176143 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-31a98a2b-80d7-410d-b010-c6cad1f67ef8 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1368 microversion: 2.1 time: 0.392657 Jun 06 13:14:28.176707 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 410/802] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:27 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1368 bytes in 394 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:28.478900 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-36bbfc46-6a4b-414c-bd74-491d33b07007 req-20c465d9-9c2e-4b98-a758-9a206e3f7302 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6f51ea-9ed2-4db7-84ac-f8c4e438741d", "name": "network-vif-plugged", "status": "completed", "tag": "7c1f42d9-3d50-49f7-bf0a-b51558b54975"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:28.487849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-36bbfc46-6a4b-414c-bd74-491d33b07007 req-20c465d9-9c2e-4b98-a758-9a206e3f7302 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:28.488288 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-36bbfc46-6a4b-414c-bd74-491d33b07007 req-20c465d9-9c2e-4b98-a758-9a206e3f7302 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:28.502980 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-36bbfc46-6a4b-414c-bd74-491d33b07007 req-20c465d9-9c2e-4b98-a758-9a206e3f7302 service nova] Creating event network-vif-plugged:7c1f42d9-3d50-49f7-bf0a-b51558b54975 for instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d on hv-cinder-75510 Jun 06 13:14:28.507806 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-36bbfc46-6a4b-414c-bd74-491d33b07007 req-20c465d9-9c2e-4b98-a758-9a206e3f7302 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032615 Jun 06 13:14:28.508410 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 393/803] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:28 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:28.801835 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-82a3ec7c-bb7d-4b03-adfd-480111a455b3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:28.802614 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-82a3ec7c-bb7d-4b03-adfd-480111a455b3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:28.803089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ab28c0ab-8fde-4f14-a121-1c8446819f39 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:28.804260 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ab28c0ab-8fde-4f14-a121-1c8446819f39 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:28.806395 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:28.810675 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82a3ec7c-bb7d-4b03-adfd-480111a455b3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:28.811377 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82a3ec7c-bb7d-4b03-adfd-480111a455b3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:28.812942 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82a3ec7c-bb7d-4b03-adfd-480111a455b3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:28.813190 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ab28c0ab-8fde-4f14-a121-1c8446819f39 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:28.813285 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82a3ec7c-bb7d-4b03-adfd-480111a455b3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:28.814047 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ab28c0ab-8fde-4f14-a121-1c8446819f39 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:28.815055 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ab28c0ab-8fde-4f14-a121-1c8446819f39 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:28.815715 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ab28c0ab-8fde-4f14-a121-1c8446819f39 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:29.045708 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:29.064513 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ab28c0ab-8fde-4f14-a121-1c8446819f39 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:29.067622 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-82a3ec7c-bb7d-4b03-adfd-480111a455b3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:29.074168 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ab28c0ab-8fde-4f14-a121-1c8446819f39 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:29.082583 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-82a3ec7c-bb7d-4b03-adfd-480111a455b3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1264 microversion: 2.1 time: 0.280949 Jun 06 13:14:29.083076 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ab28c0ab-8fde-4f14-a121-1c8446819f39 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:29.083076 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ab28c0ab-8fde-4f14-a121-1c8446819f39 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.279286 Jun 06 13:14:29.084192 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 411/804] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:28 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1264 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:29.088619 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 394/805] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:28 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:14:29.194314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-75bc38b7-2327-410b-a6b7-b3b2588f417f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:29.195061 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-75bc38b7-2327-410b-a6b7-b3b2588f417f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:29.201992 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-75bc38b7-2327-410b-a6b7-b3b2588f417f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:29.202434 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-75bc38b7-2327-410b-a6b7-b3b2588f417f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:29.203192 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-75bc38b7-2327-410b-a6b7-b3b2588f417f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:29.203633 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-75bc38b7-2327-410b-a6b7-b3b2588f417f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:29.335681 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-75bc38b7-2327-410b-a6b7-b3b2588f417f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:29.344511 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-75bc38b7-2327-410b-a6b7-b3b2588f417f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1368 microversion: 2.1 time: 0.154069 Jun 06 13:14:29.345340 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 412/806] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:29 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1368 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:14:29.534885 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cd30a776-2073-4406-af9b-2c1557ecee7e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-1974477596"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:29.535418 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-cd30a776-2073-4406-af9b-2c1557ecee7e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:29.537203 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=12 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:29.542337 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cd30a776-2073-4406-af9b-2c1557ecee7e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:29.542778 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cd30a776-2073-4406-af9b-2c1557ecee7e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:29.543603 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cd30a776-2073-4406-af9b-2c1557ecee7e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:29.544033 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cd30a776-2073-4406-af9b-2c1557ecee7e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:29.675374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.network.security_group_api [None req-cd30a776-2073-4406-af9b-2c1557ecee7e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Removing security group 3ac3d26a-e687-4180-87d4-c5cb7b90f24b from port f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb Jun 06 13:14:30.096611 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b10f2012-0949-4fa8-93e6-530662472588 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:30.097246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b10f2012-0949-4fa8-93e6-530662472588 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:30.099236 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=8 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:30.106444 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b10f2012-0949-4fa8-93e6-530662472588 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:30.107390 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b10f2012-0949-4fa8-93e6-530662472588 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:30.108950 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b10f2012-0949-4fa8-93e6-530662472588 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:30.111746 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b10f2012-0949-4fa8-93e6-530662472588 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:30.169568 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cd30a776-2073-4406-af9b-2c1557ecee7e tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "POST /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/action" status: 202 len: 0 microversion: 2.1 time: 0.638704 Jun 06 13:14:30.171298 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 395/807] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:14:29 2022] POST /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/action => generated 0 bytes in 641 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:14:30.180098 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-634b6f9d-0a7b-43ee-8c3c-52e8217260b8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:30.180719 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-634b6f9d-0a7b-43ee-8c3c-52e8217260b8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:30.197374 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-634b6f9d-0a7b-43ee-8c3c-52e8217260b8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:30.198440 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-634b6f9d-0a7b-43ee-8c3c-52e8217260b8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:30.199002 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-634b6f9d-0a7b-43ee-8c3c-52e8217260b8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:30.199567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-634b6f9d-0a7b-43ee-8c3c-52e8217260b8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:30.438611 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b10f2012-0949-4fa8-93e6-530662472588 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:30.469703 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b10f2012-0949-4fa8-93e6-530662472588 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:30.472956 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b10f2012-0949-4fa8-93e6-530662472588 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:30.488087 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b10f2012-0949-4fa8-93e6-530662472588 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.382449 Jun 06 13:14:30.488087 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 413/808] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:30 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:14:30.493128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-634b6f9d-0a7b-43ee-8c3c-52e8217260b8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:30.494273 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-20d0b4cf-21ec-4074-9861-13a28c74a12f req-76c79cb4-f0ca-44f6-9e10-796a1f155266 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87090e23-8967-41e3-93f5-2c475fe348cf", "tag": "f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:30.502829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-20d0b4cf-21ec-4074-9861-13a28c74a12f req-76c79cb4-f0ca-44f6-9e10-796a1f155266 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:30.503336 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-634b6f9d-0a7b-43ee-8c3c-52e8217260b8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1264 microversion: 2.1 time: 0.330485 Jun 06 13:14:30.503824 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-20d0b4cf-21ec-4074-9861-13a28c74a12f req-76c79cb4-f0ca-44f6-9e10-796a1f155266 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:30.504765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 396/809] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:30 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1264 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:30.510576 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e84a2df4-e941-4131-bb4e-eba8f2762c64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:30.511182 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e84a2df4-e941-4131-bb4e-eba8f2762c64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:30.517187 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-20d0b4cf-21ec-4074-9861-13a28c74a12f req-76c79cb4-f0ca-44f6-9e10-796a1f155266 service nova] Creating event network-changed:f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb for instance 87090e23-8967-41e3-93f5-2c475fe348cf on hv-cinder-75510 Jun 06 13:14:30.519273 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e84a2df4-e941-4131-bb4e-eba8f2762c64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:30.519768 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e84a2df4-e941-4131-bb4e-eba8f2762c64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:30.521150 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e84a2df4-e941-4131-bb4e-eba8f2762c64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:30.521594 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e84a2df4-e941-4131-bb4e-eba8f2762c64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:30.523893 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-20d0b4cf-21ec-4074-9861-13a28c74a12f req-76c79cb4-f0ca-44f6-9e10-796a1f155266 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046410 Jun 06 13:14:30.524666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 414/810] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:30.844009 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e84a2df4-e941-4131-bb4e-eba8f2762c64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:30.853852 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e84a2df4-e941-4131-bb4e-eba8f2762c64 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1368 microversion: 2.1 time: 0.347887 Jun 06 13:14:30.855067 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 397/811] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:30 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1368 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:31.496445 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-03cbb503-997f-4641-9066-87982a8d0b52 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:31.497135 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-03cbb503-997f-4641-9066-87982a8d0b52 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:31.504501 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03cbb503-997f-4641-9066-87982a8d0b52 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:31.504949 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03cbb503-997f-4641-9066-87982a8d0b52 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:31.505738 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03cbb503-997f-4641-9066-87982a8d0b52 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:31.506350 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-03cbb503-997f-4641-9066-87982a8d0b52 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:31.520328 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f0d7830c-07a7-4f10-bbfe-d943d969a378 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:31.520941 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f0d7830c-07a7-4f10-bbfe-d943d969a378 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:31.534267 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f0d7830c-07a7-4f10-bbfe-d943d969a378 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:31.535025 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f0d7830c-07a7-4f10-bbfe-d943d969a378 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:31.535829 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f0d7830c-07a7-4f10-bbfe-d943d969a378 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:31.536738 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f0d7830c-07a7-4f10-bbfe-d943d969a378 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:31.805059 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f0d7830c-07a7-4f10-bbfe-d943d969a378 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:31.812156 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-03cbb503-997f-4641-9066-87982a8d0b52 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:31.820537 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f0d7830c-07a7-4f10-bbfe-d943d969a378 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1264 microversion: 2.1 time: 0.302604 Jun 06 13:14:31.823019 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 398/812] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:31 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1264 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:14:31.826996 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-03cbb503-997f-4641-9066-87982a8d0b52 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:31.829795 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-03cbb503-997f-4641-9066-87982a8d0b52 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:31.831357 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-03cbb503-997f-4641-9066-87982a8d0b52 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.340233 Jun 06 13:14:31.832598 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 415/813] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:31 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:31.832845 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2f600ced-b696-42bb-978e-9c256b15409c tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:31.833567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2f600ced-b696-42bb-978e-9c256b15409c tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:31.840462 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2f600ced-b696-42bb-978e-9c256b15409c tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:31.841178 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2f600ced-b696-42bb-978e-9c256b15409c tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:31.842711 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2f600ced-b696-42bb-978e-9c256b15409c tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:31.843329 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2f600ced-b696-42bb-978e-9c256b15409c tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:31.873163 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fea4acd4-a05e-419d-9c69-cdb4693351be tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:31.874353 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fea4acd4-a05e-419d-9c69-cdb4693351be tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:31.881523 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fea4acd4-a05e-419d-9c69-cdb4693351be tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:31.882375 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fea4acd4-a05e-419d-9c69-cdb4693351be tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:31.883497 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fea4acd4-a05e-419d-9c69-cdb4693351be tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:31.884247 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fea4acd4-a05e-419d-9c69-cdb4693351be tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:31.973397 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-2f600ced-b696-42bb-978e-9c256b15409c tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lazy-loading 'services' on Instance uuid 87090e23-8967-41e3-93f5-2c475fe348cf {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:14:32.072124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fea4acd4-a05e-419d-9c69-cdb4693351be tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:32.083060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fea4acd4-a05e-419d-9c69-cdb4693351be tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1558 microversion: 2.1 time: 0.215053 Jun 06 13:14:32.083713 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 416/814] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:31 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1558 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:32.107065 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-da285bdf-2ae3-4122-b928-27be4b59d066 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:32.108214 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-da285bdf-2ae3-4122-b928-27be4b59d066 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:32.115322 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-da285bdf-2ae3-4122-b928-27be4b59d066 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:32.116157 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-da285bdf-2ae3-4122-b928-27be4b59d066 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:32.117570 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-da285bdf-2ae3-4122-b928-27be4b59d066 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:32.118179 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-da285bdf-2ae3-4122-b928-27be4b59d066 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:32.223865 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-da285bdf-2ae3-4122-b928-27be4b59d066 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.121055 Jun 06 13:14:32.224452 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 417/815] 10.222.0.13 () {58 vars in 1274 bytes} [Mon Jun 6 13:14:32 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-interface => generated 284 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:14:32.249349 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2f600ced-b696-42bb-978e-9c256b15409c tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "DELETE /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/os-volume_attachments/fe09353a-b690-41be-a143-69be08531a6b" status: 202 len: 0 microversion: 2.1 time: 0.424663 Jun 06 13:14:32.250031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 399/816] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 13:14:31 2022] DELETE /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/os-volume_attachments/fe09353a-b690-41be-a143-69be08531a6b => generated 0 bytes in 426 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:14:32.322247 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b2065217-a28f-4bac-9889-ecfdc9f4d73d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:32.323144 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b2065217-a28f-4bac-9889-ecfdc9f4d73d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:32.330327 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b2065217-a28f-4bac-9889-ecfdc9f4d73d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:32.330564 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b2065217-a28f-4bac-9889-ecfdc9f4d73d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:32.334365 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b2065217-a28f-4bac-9889-ecfdc9f4d73d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:32.334365 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b2065217-a28f-4bac-9889-ecfdc9f4d73d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:32.365174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b2065217-a28f-4bac-9889-ecfdc9f4d73d tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046992 Jun 06 13:14:32.365765 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 418/817] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:14:32 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:32.545808 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-79405073-36c6-49dd-a7ed-11fa7cec41ec req-3a97c076-5da9-48f4-b6c4-528d95e6b8d5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "87090e23-8967-41e3-93f5-2c475fe348cf", "tag": "f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:32.555459 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-79405073-36c6-49dd-a7ed-11fa7cec41ec req-3a97c076-5da9-48f4-b6c4-528d95e6b8d5 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:32.555944 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-79405073-36c6-49dd-a7ed-11fa7cec41ec req-3a97c076-5da9-48f4-b6c4-528d95e6b8d5 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:32.568618 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-79405073-36c6-49dd-a7ed-11fa7cec41ec req-3a97c076-5da9-48f4-b6c4-528d95e6b8d5 service nova] Creating event network-changed:f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb for instance 87090e23-8967-41e3-93f5-2c475fe348cf on hv-cinder-75510 Jun 06 13:14:32.577553 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-79405073-36c6-49dd-a7ed-11fa7cec41ec req-3a97c076-5da9-48f4-b6c4-528d95e6b8d5 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036309 Jun 06 13:14:32.578526 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 400/818] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:32 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:32.839415 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4913f5fe-3895-4764-8a6f-31a8c1d08ea2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:32.840250 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4913f5fe-3895-4764-8a6f-31a8c1d08ea2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:32.848325 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4913f5fe-3895-4764-8a6f-31a8c1d08ea2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:32.848866 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4913f5fe-3895-4764-8a6f-31a8c1d08ea2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:32.849711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4913f5fe-3895-4764-8a6f-31a8c1d08ea2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:32.850212 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4913f5fe-3895-4764-8a6f-31a8c1d08ea2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:32.851039 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e6f3ad03-d828-47ad-9ea7-be20c4b825b9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:32.851824 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e6f3ad03-d828-47ad-9ea7-be20c4b825b9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:32.861318 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e6f3ad03-d828-47ad-9ea7-be20c4b825b9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:32.862097 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e6f3ad03-d828-47ad-9ea7-be20c4b825b9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:32.863232 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e6f3ad03-d828-47ad-9ea7-be20c4b825b9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:32.863856 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e6f3ad03-d828-47ad-9ea7-be20c4b825b9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:33.415079 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4913f5fe-3895-4764-8a6f-31a8c1d08ea2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:33.415079 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4913f5fe-3895-4764-8a6f-31a8c1d08ea2 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1264 microversion: 2.1 time: 0.577745 Jun 06 13:14:33.415079 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 419/819] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:32 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1264 bytes in 579 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:33.419698 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-471de2d5-e904-4517-a460-00e6cc6f7cea tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:33.421269 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-471de2d5-e904-4517-a460-00e6cc6f7cea tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:33.421879 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e6f3ad03-d828-47ad-9ea7-be20c4b825b9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:33.429858 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-471de2d5-e904-4517-a460-00e6cc6f7cea tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:33.430900 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-471de2d5-e904-4517-a460-00e6cc6f7cea tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:33.432085 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-471de2d5-e904-4517-a460-00e6cc6f7cea tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:33.432699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-471de2d5-e904-4517-a460-00e6cc6f7cea tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:33.433174 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e6f3ad03-d828-47ad-9ea7-be20c4b825b9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:33.437461 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e6f3ad03-d828-47ad-9ea7-be20c4b825b9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:33.439817 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e6f3ad03-d828-47ad-9ea7-be20c4b825b9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.592952 Jun 06 13:14:33.441074 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 401/820] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:32 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 595 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:33.470843 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-471de2d5-e904-4517-a460-00e6cc6f7cea tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.055746 Jun 06 13:14:33.471447 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 420/821] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:14:33 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/os-volume_attachments => generated 197 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:34.432631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2c50ab73-e8cb-4487-8141-321c96c167f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:34.433192 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2c50ab73-e8cb-4487-8141-321c96c167f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:34.440435 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2c50ab73-e8cb-4487-8141-321c96c167f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:34.441318 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2c50ab73-e8cb-4487-8141-321c96c167f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:34.442098 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2c50ab73-e8cb-4487-8141-321c96c167f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:34.442525 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2c50ab73-e8cb-4487-8141-321c96c167f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:34.480882 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9a4eef07-d423-4cf3-8e6a-0d51c92e51ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:34.480882 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9a4eef07-d423-4cf3-8e6a-0d51c92e51ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:34.492277 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a4eef07-d423-4cf3-8e6a-0d51c92e51ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:34.492797 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a4eef07-d423-4cf3-8e6a-0d51c92e51ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:34.493746 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a4eef07-d423-4cf3-8e6a-0d51c92e51ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:34.495609 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9a4eef07-d423-4cf3-8e6a-0d51c92e51ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:34.500552 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:34.699964 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-2c50ab73-e8cb-4487-8141-321c96c167f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:34.703363 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9a4eef07-d423-4cf3-8e6a-0d51c92e51ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:34.708505 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2c50ab73-e8cb-4487-8141-321c96c167f8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1264 microversion: 2.1 time: 0.280590 Jun 06 13:14:34.711048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 402/822] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:34 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1264 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:34.712568 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9a4eef07-d423-4cf3-8e6a-0d51c92e51ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:34.719504 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9a4eef07-d423-4cf3-8e6a-0d51c92e51ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:34.720923 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9a4eef07-d423-4cf3-8e6a-0d51c92e51ba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.246896 Jun 06 13:14:34.721585 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 421/823] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:34 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:34.723730 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3faa442e-fba0-4ad8-9836-36a7f897e431 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:34.725768 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3faa442e-fba0-4ad8-9836-36a7f897e431 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:34.726889 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-5fc60412-4f58-4fc9-a38e-15e039a1a813 req-f3764ae7-877b-4b86-85d3-2f714257779b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "9c6f51ea-9ed2-4db7-84ac-f8c4e438741d", "tag": "7c1f42d9-3d50-49f7-bf0a-b51558b54975"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:34.733115 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3faa442e-fba0-4ad8-9836-36a7f897e431 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:34.734329 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3faa442e-fba0-4ad8-9836-36a7f897e431 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:34.734600 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3faa442e-fba0-4ad8-9836-36a7f897e431 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:34.734824 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3faa442e-fba0-4ad8-9836-36a7f897e431 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:34.738087 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-5fc60412-4f58-4fc9-a38e-15e039a1a813 req-f3764ae7-877b-4b86-85d3-2f714257779b service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:34.738500 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-5fc60412-4f58-4fc9-a38e-15e039a1a813 req-f3764ae7-877b-4b86-85d3-2f714257779b service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:34.751758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=99,nova_cell1:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:34.752000 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-5fc60412-4f58-4fc9-a38e-15e039a1a813 req-f3764ae7-877b-4b86-85d3-2f714257779b service nova] Creating event network-changed:7c1f42d9-3d50-49f7-bf0a-b51558b54975 for instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d on hv-cinder-75510 Jun 06 13:14:34.756783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-5fc60412-4f58-4fc9-a38e-15e039a1a813 req-f3764ae7-877b-4b86-85d3-2f714257779b service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033678 Jun 06 13:14:34.757384 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 422/824] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:34.769742 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3faa442e-fba0-4ad8-9836-36a7f897e431 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.058987 Jun 06 13:14:34.773597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 403/825] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:14:34 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/os-volume_attachments => generated 25 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 13:14:34.781645 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4395d1db-d692-4edf-8d3c-8c9a354f38f9 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:34.782225 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4395d1db-d692-4edf-8d3c-8c9a354f38f9 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:34.789102 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4395d1db-d692-4edf-8d3c-8c9a354f38f9 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:34.789689 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4395d1db-d692-4edf-8d3c-8c9a354f38f9 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:34.790468 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4395d1db-d692-4edf-8d3c-8c9a354f38f9 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:34.790903 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4395d1db-d692-4edf-8d3c-8c9a354f38f9 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:34.870819 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-4395d1db-d692-4edf-8d3c-8c9a354f38f9 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] HTTP exception thrown: Instance 87090e23-8967-41e3-93f5-2c475fe348cf is not attached to volume fe09353a-b690-41be-a143-69be08531a6b Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4395d1db-d692-4edf-8d3c-8c9a354f38f9 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Request method failure captured: Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/os-volume_attachments/fe09353a-b690-41be-a143-69be08531a6b HTTP/1.1 Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinf0cCyLhk4BhIPQPbWs8bl592tuIUQIS-bIh05WjfpX7UoezdOkQfN7GQomcy5njbVPROyUiE5d7iJAHhe-xmep4viP1uQUyF-bcGWKRxIfXLLiysrTeR1iM83RddWM_qLZq7Fzi6FTsSIA3arX7kk-VGQB-dING3mZDn7-umx76OUs Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: ef58e682b96f4a2cb0b35ad6eee991e5 Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-TestMinimumBasicScenario-455638436 Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:14:34.873416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:14:34.875086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ef58e682b96f4a2cb0b35ad6eee991e5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ef58e682b96f4a2cb0b35ad6eee991e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ef58e682b96f4a2cb0b35ad6eee991e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ef58e682b96f4a2cb0b35ad6eee991e5"}]}] Jun 06 13:14:34.875086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-TestMinimumBasicScenario-455638436 Jun 06 13:14:34.875086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: ef58e682b96f4a2cb0b35ad6eee991e5 Jun 06 13:14:34.875086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-TestMinimumBasicScenario-455638436 Jun 06 13:14:34.875086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-TestMinimumBasicScenario-455638436-project Jun 06 13:14:34.875086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:14:34.875086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:14:34.875086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: d6dad40e92684d1f95fc9b3b0a0337ed Jun 06 13:14:34.875086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-TestMinimumBasicScenario-455638436-project Jun 06 13:14:34.875086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:14:34.875086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance 87090e23-8967-41e3-93f5-2c475fe348cf is not attached to volume fe09353a-b690-41be-a143-69be08531a6b Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'server_id': '87090e23-8967-41e3-93f5-2c475fe348cf', 'id': 'fe09353a-b690-41be-a143-69be08531a6b'} Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 281, in get_by_volume_and_instance Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id fe09353a-b690-41be-a143-69be08531a6b. Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:14:34.881686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87090e23-8967-41e3-93f5-2c475fe348cf is not attached to volume fe09353a-b690-41be-a143-69be08531a6b Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87090e23-8967-41e3-93f5-2c475fe348cf is not attached to volume fe09353a-b690-41be-a143-69be08531a6b Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:34.883764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4395d1db-d692-4edf-8d3c-8c9a354f38f9 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Returning 404 to user: Instance 87090e23-8967-41e3-93f5-2c475fe348cf is not attached to volume fe09353a-b690-41be-a143-69be08531a6b {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:14:34.884921 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4395d1db-d692-4edf-8d3c-8c9a354f38f9 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "DELETE /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/os-volume_attachments/fe09353a-b690-41be-a143-69be08531a6b" status: 404 len: 154 microversion: 2.1 time: 0.098189 Jun 06 13:14:34.884921 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 423/826] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 13:14:34 2022] DELETE /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf/os-volume_attachments/fe09353a-b690-41be-a143-69be08531a6b => generated 154 bytes in 103 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:14:35.726986 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4eaa8b17-4d45-4d5f-8e09-0898416f069e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:35.727569 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-4eaa8b17-4d45-4d5f-8e09-0898416f069e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:35.734512 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4eaa8b17-4d45-4d5f-8e09-0898416f069e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:35.734965 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4eaa8b17-4d45-4d5f-8e09-0898416f069e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:35.735774 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4eaa8b17-4d45-4d5f-8e09-0898416f069e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:35.736289 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4eaa8b17-4d45-4d5f-8e09-0898416f069e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:35.742107 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-413cf604-18ab-4786-85b7-cfb611aa6ac6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:35.742865 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-413cf604-18ab-4786-85b7-cfb611aa6ac6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:35.749844 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-413cf604-18ab-4786-85b7-cfb611aa6ac6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:35.750295 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-413cf604-18ab-4786-85b7-cfb611aa6ac6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:35.751073 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-413cf604-18ab-4786-85b7-cfb611aa6ac6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:35.751514 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-413cf604-18ab-4786-85b7-cfb611aa6ac6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:35.944473 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-4eaa8b17-4d45-4d5f-8e09-0898416f069e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:35.952464 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-413cf604-18ab-4786-85b7-cfb611aa6ac6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:35.952931 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-4eaa8b17-4d45-4d5f-8e09-0898416f069e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1264 microversion: 2.1 time: 0.230479 Jun 06 13:14:35.953512 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 404/827] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:35 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:35.966080 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-413cf604-18ab-4786-85b7-cfb611aa6ac6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:35.967138 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-413cf604-18ab-4786-85b7-cfb611aa6ac6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:35.968368 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-413cf604-18ab-4786-85b7-cfb611aa6ac6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.230408 Jun 06 13:14:35.968908 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 424/828] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:35 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:14:36.184720 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-25758373-48da-44e0-bd18-35f9083cbda4 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:36.185719 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-25758373-48da-44e0-bd18-35f9083cbda4 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:36.191656 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-25758373-48da-44e0-bd18-35f9083cbda4 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:36.198108 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-25758373-48da-44e0-bd18-35f9083cbda4 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:36.198108 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-25758373-48da-44e0-bd18-35f9083cbda4 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:36.198108 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-25758373-48da-44e0-bd18-35f9083cbda4 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:36.218717 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-25758373-48da-44e0-bd18-35f9083cbda4 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Going to try to terminate instance {{(pid=118134) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:14:36.500753 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-25758373-48da-44e0-bd18-35f9083cbda4 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "DELETE /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 204 len: 0 microversion: 2.1 time: 0.319560 Jun 06 13:14:36.503725 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 405/829] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:14:36 2022] DELETE /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 0 bytes in 321 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:14:36.509829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-099e2143-200b-467c-9bde-7c00a5b779a6 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:36.510440 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-099e2143-200b-467c-9bde-7c00a5b779a6 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:36.517220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-099e2143-200b-467c-9bde-7c00a5b779a6 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:36.517764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-099e2143-200b-467c-9bde-7c00a5b779a6 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:36.518589 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-099e2143-200b-467c-9bde-7c00a5b779a6 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:36.519090 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-099e2143-200b-467c-9bde-7c00a5b779a6 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:36.539166 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-f8e607cd-41d1-4fc8-9a13-cd166782e524 req-9d4c9a14-f5a1-4bf3-9743-82c5fedebb23 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787b0a77-8cba-4834-98e8-4524ac3e03d7", "name": "network-vif-plugged", "status": "completed", "tag": "0bb1b662-7ea0-4f9a-b1f3-e9c46704c25e"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:36.548279 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-f8e607cd-41d1-4fc8-9a13-cd166782e524 req-9d4c9a14-f5a1-4bf3-9743-82c5fedebb23 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:36.548722 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-f8e607cd-41d1-4fc8-9a13-cd166782e524 req-9d4c9a14-f5a1-4bf3-9743-82c5fedebb23 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:36.559662 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-f8e607cd-41d1-4fc8-9a13-cd166782e524 req-9d4c9a14-f5a1-4bf3-9743-82c5fedebb23 service nova] Creating event network-vif-plugged:0bb1b662-7ea0-4f9a-b1f3-e9c46704c25e for instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 on hv-cinder-75510 Jun 06 13:14:36.565148 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-f8e607cd-41d1-4fc8-9a13-cd166782e524 req-9d4c9a14-f5a1-4bf3-9743-82c5fedebb23 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029927 Jun 06 13:14:36.565852 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 406/830] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:36 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:36.675450 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-099e2143-200b-467c-9bde-7c00a5b779a6 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:36.684064 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-099e2143-200b-467c-9bde-7c00a5b779a6 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1551 microversion: 2.1 time: 0.178063 Jun 06 13:14:36.685604 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 425/831] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:36 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1551 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:36.970974 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-16ec8300-ccbe-4d2e-a718-daa3dc73d48e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:36.971688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-16ec8300-ccbe-4d2e-a718-daa3dc73d48e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:36.978266 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-16ec8300-ccbe-4d2e-a718-daa3dc73d48e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:36.978738 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-16ec8300-ccbe-4d2e-a718-daa3dc73d48e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:36.979502 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-16ec8300-ccbe-4d2e-a718-daa3dc73d48e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:36.982438 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-16ec8300-ccbe-4d2e-a718-daa3dc73d48e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:36.987212 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5a1d4675-ca49-4702-a8bf-5efdfaffe222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:36.987854 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5a1d4675-ca49-4702-a8bf-5efdfaffe222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:36.994320 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5a1d4675-ca49-4702-a8bf-5efdfaffe222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:36.994772 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5a1d4675-ca49-4702-a8bf-5efdfaffe222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:36.995764 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5a1d4675-ca49-4702-a8bf-5efdfaffe222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:36.996197 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5a1d4675-ca49-4702-a8bf-5efdfaffe222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:37.187224 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-16ec8300-ccbe-4d2e-a718-daa3dc73d48e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:37.193531 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5a1d4675-ca49-4702-a8bf-5efdfaffe222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:37.202905 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-16ec8300-ccbe-4d2e-a718-daa3dc73d48e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1264 microversion: 2.1 time: 0.237217 Jun 06 13:14:37.203476 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 407/832] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:36 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1264 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:37.203916 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5a1d4675-ca49-4702-a8bf-5efdfaffe222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:37.205437 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5a1d4675-ca49-4702-a8bf-5efdfaffe222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:37.206602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5a1d4675-ca49-4702-a8bf-5efdfaffe222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.223449 Jun 06 13:14:37.207156 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 426/833] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:36 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:14:37.703472 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-67ef6a7a-5c49-45af-bde9-d152c9ff8747 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:37.704156 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-67ef6a7a-5c49-45af-bde9-d152c9ff8747 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:37.710239 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67ef6a7a-5c49-45af-bde9-d152c9ff8747 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:37.710687 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67ef6a7a-5c49-45af-bde9-d152c9ff8747 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:37.711471 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67ef6a7a-5c49-45af-bde9-d152c9ff8747 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:37.711921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67ef6a7a-5c49-45af-bde9-d152c9ff8747 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:37.846556 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-67ef6a7a-5c49-45af-bde9-d152c9ff8747 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:37.854179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-67ef6a7a-5c49-45af-bde9-d152c9ff8747 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1551 microversion: 2.1 time: 0.155803 Jun 06 13:14:37.858091 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 408/834] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:37 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1551 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:38.219834 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8f0e6017-2fb2-4ac6-9f7e-3007350ab828 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:38.220443 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8f0e6017-2fb2-4ac6-9f7e-3007350ab828 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:38.225980 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e50d0d81-6e6c-4312-b42f-af600bbc84f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:38.226581 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e50d0d81-6e6c-4312-b42f-af600bbc84f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:38.226992 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8f0e6017-2fb2-4ac6-9f7e-3007350ab828 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:38.227445 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8f0e6017-2fb2-4ac6-9f7e-3007350ab828 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:38.228250 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8f0e6017-2fb2-4ac6-9f7e-3007350ab828 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:38.228738 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8f0e6017-2fb2-4ac6-9f7e-3007350ab828 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:38.234042 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e50d0d81-6e6c-4312-b42f-af600bbc84f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:38.234484 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e50d0d81-6e6c-4312-b42f-af600bbc84f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:38.235292 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e50d0d81-6e6c-4312-b42f-af600bbc84f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:38.235936 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e50d0d81-6e6c-4312-b42f-af600bbc84f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:38.442964 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e50d0d81-6e6c-4312-b42f-af600bbc84f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:38.452626 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e50d0d81-6e6c-4312-b42f-af600bbc84f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:38.454405 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e50d0d81-6e6c-4312-b42f-af600bbc84f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:38.455808 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e50d0d81-6e6c-4312-b42f-af600bbc84f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.233723 Jun 06 13:14:38.456697 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 409/835] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:38 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:14:38.472005 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8f0e6017-2fb2-4ac6-9f7e-3007350ab828 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:38.481013 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8f0e6017-2fb2-4ac6-9f7e-3007350ab828 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1264 microversion: 2.1 time: 0.265706 Jun 06 13:14:38.481597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 427/836] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:38 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1264 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:38.873562 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-38b59746-64e5-446d-abfd-904824e38aad tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:38.874228 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-38b59746-64e5-446d-abfd-904824e38aad tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:38.880159 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38b59746-64e5-446d-abfd-904824e38aad tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:38.880595 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38b59746-64e5-446d-abfd-904824e38aad tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:38.881351 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38b59746-64e5-446d-abfd-904824e38aad tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:38.881777 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-38b59746-64e5-446d-abfd-904824e38aad tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:38.953054 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-38b59746-64e5-446d-abfd-904824e38aad tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:38.963189 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-38b59746-64e5-446d-abfd-904824e38aad tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1509 microversion: 2.1 time: 0.093102 Jun 06 13:14:38.963812 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 410/837] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:38 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1509 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:39.052829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-ca8e7bc5-a3de-411b-b894-b0afecfd2cd9 req-2ccbcc19-7245-4e95-b226-498d31f5fed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "87090e23-8967-41e3-93f5-2c475fe348cf", "name": "network-vif-deleted", "tag": "f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:39.061235 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-ca8e7bc5-a3de-411b-b894-b0afecfd2cd9 req-2ccbcc19-7245-4e95-b226-498d31f5fed6 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:39.061672 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-ca8e7bc5-a3de-411b-b894-b0afecfd2cd9 req-2ccbcc19-7245-4e95-b226-498d31f5fed6 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:39.072707 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-ca8e7bc5-a3de-411b-b894-b0afecfd2cd9 req-2ccbcc19-7245-4e95-b226-498d31f5fed6 service nova] Creating event network-vif-deleted:f7fdc7c0-0e1f-4b89-ba44-b6acf6c030fb for instance 87090e23-8967-41e3-93f5-2c475fe348cf on hv-cinder-75510 Jun 06 13:14:39.077851 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-ca8e7bc5-a3de-411b-b894-b0afecfd2cd9 req-2ccbcc19-7245-4e95-b226-498d31f5fed6 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028785 Jun 06 13:14:39.078827 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 428/838] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:39.475444 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6d57432f-34fe-42ed-b1bf-98280c6fc817 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:39.476106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6d57432f-34fe-42ed-b1bf-98280c6fc817 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:39.486494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6d57432f-34fe-42ed-b1bf-98280c6fc817 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:39.486494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6d57432f-34fe-42ed-b1bf-98280c6fc817 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:39.486494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6d57432f-34fe-42ed-b1bf-98280c6fc817 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:39.486494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6d57432f-34fe-42ed-b1bf-98280c6fc817 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:39.499896 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a1d6d65b-94ad-4d2d-b80a-9faa835c8655 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:39.500443 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a1d6d65b-94ad-4d2d-b80a-9faa835c8655 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:39.506973 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1d6d65b-94ad-4d2d-b80a-9faa835c8655 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:39.507429 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1d6d65b-94ad-4d2d-b80a-9faa835c8655 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:39.508242 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1d6d65b-94ad-4d2d-b80a-9faa835c8655 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:39.508680 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a1d6d65b-94ad-4d2d-b80a-9faa835c8655 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:39.712728 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6d57432f-34fe-42ed-b1bf-98280c6fc817 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:39.716120 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a1d6d65b-94ad-4d2d-b80a-9faa835c8655 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:39.724427 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a1d6d65b-94ad-4d2d-b80a-9faa835c8655 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1264 microversion: 2.1 time: 0.230010 Jun 06 13:14:39.725008 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 429/839] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:39 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1264 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:14:39.726819 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6d57432f-34fe-42ed-b1bf-98280c6fc817 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:39.728492 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6d57432f-34fe-42ed-b1bf-98280c6fc817 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:39.729642 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6d57432f-34fe-42ed-b1bf-98280c6fc817 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.259299 Jun 06 13:14:39.730184 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 411/840] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:39 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:14:39.981512 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-41cf5c9f-6004-4625-9add-13b4be7a1e2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:39.982608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-41cf5c9f-6004-4625-9add-13b4be7a1e2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:39.988886 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41cf5c9f-6004-4625-9add-13b4be7a1e2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:39.989335 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41cf5c9f-6004-4625-9add-13b4be7a1e2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:39.990103 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41cf5c9f-6004-4625-9add-13b4be7a1e2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:39.990539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41cf5c9f-6004-4625-9add-13b4be7a1e2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:40.025509 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41cf5c9f-6004-4625-9add-13b4be7a1e2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:40.025958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41cf5c9f-6004-4625-9add-13b4be7a1e2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:40.026402 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-41cf5c9f-6004-4625-9add-13b4be7a1e2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lazy-loading 'fault' on Instance uuid 87090e23-8967-41e3-93f5-2c475fe348cf {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:14:40.068534 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-41cf5c9f-6004-4625-9add-13b4be7a1e2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'd6dad40e92684d1f95fc9b3b0a0337ed', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'ef58e682b96f4a2cb0b35ad6eee991e5', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:40.077077 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-41cf5c9f-6004-4625-9add-13b4be7a1e2b tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 200 len: 1346 microversion: 2.1 time: 0.099428 Jun 06 13:14:40.078349 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 430/841] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:39 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 1346 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:40.741951 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-31c766dd-2b4c-4710-a8e4-eeedda2fba0b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:40.742656 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-31c766dd-2b4c-4710-a8e4-eeedda2fba0b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:40.750043 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-31c766dd-2b4c-4710-a8e4-eeedda2fba0b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:40.750571 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-31c766dd-2b4c-4710-a8e4-eeedda2fba0b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:40.750755 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-de2963e4-f6fd-4b79-9216-d59cc5fbc652 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:40.751323 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-de2963e4-f6fd-4b79-9216-d59cc5fbc652 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:40.751497 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-31c766dd-2b4c-4710-a8e4-eeedda2fba0b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:40.752281 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-31c766dd-2b4c-4710-a8e4-eeedda2fba0b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:40.757988 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de2963e4-f6fd-4b79-9216-d59cc5fbc652 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:40.758430 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de2963e4-f6fd-4b79-9216-d59cc5fbc652 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:40.759189 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de2963e4-f6fd-4b79-9216-d59cc5fbc652 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:40.759652 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de2963e4-f6fd-4b79-9216-d59cc5fbc652 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:40.953143 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-31c766dd-2b4c-4710-a8e4-eeedda2fba0b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:40.961118 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-31c766dd-2b4c-4710-a8e4-eeedda2fba0b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1450 microversion: 2.1 time: 0.223149 Jun 06 13:14:40.966959 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 412/842] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:40 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1450 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:40.967248 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-de2963e4-f6fd-4b79-9216-d59cc5fbc652 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:40.978276 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5c6bc87e-ef19-477b-9476-9c6c3952e56a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:40.978964 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5c6bc87e-ef19-477b-9476-9c6c3952e56a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:40.980413 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-de2963e4-f6fd-4b79-9216-d59cc5fbc652 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:40.981985 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-de2963e4-f6fd-4b79-9216-d59cc5fbc652 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:40.983165 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-de2963e4-f6fd-4b79-9216-d59cc5fbc652 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.237048 Jun 06 13:14:40.994111 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 431/843] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:40 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:40.994214 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c6bc87e-ef19-477b-9476-9c6c3952e56a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:40.994214 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c6bc87e-ef19-477b-9476-9c6c3952e56a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:40.994214 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c6bc87e-ef19-477b-9476-9c6c3952e56a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:40.994214 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c6bc87e-ef19-477b-9476-9c6c3952e56a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:41.094413 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f1379649-f14b-4c5b-94ed-55f09c2861e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:41.095142 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f1379649-f14b-4c5b-94ed-55f09c2861e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] [instance: 87090e23-8967-41e3-93f5-2c475fe348cf] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:41.101322 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1379649-f14b-4c5b-94ed-55f09c2861e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:41.102023 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1379649-f14b-4c5b-94ed-55f09c2861e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:41.102806 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1379649-f14b-4c5b-94ed-55f09c2861e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:41.103299 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1379649-f14b-4c5b-94ed-55f09c2861e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:41.117758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-f1379649-f14b-4c5b-94ed-55f09c2861e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] HTTP exception thrown: Instance 87090e23-8967-41e3-93f5-2c475fe348cf could not be found. Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f1379649-f14b-4c5b-94ed-55f09c2861e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Request method failure captured: Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf HTTP/1.1 Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinf0cCyLhk4BhIPQPbWs8bl592tuIUQIS-bIh05WjfpX7UoezdOkQfN7GQomcy5njbVPROyUiE5d7iJAHhe-xmep4viP1uQUyF-bcGWKRxIfXLLiysrTeR1iM83RddWM_qLZq7Fzi6FTsSIA3arX7kk-VGQB-dING3mZDn7-umx76OUs Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: ef58e682b96f4a2cb0b35ad6eee991e5 Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-TestMinimumBasicScenario-455638436 Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:14:41.119245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:14:41.120597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_ef58e682b96f4a2cb0b35ad6eee991e5", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ef58e682b96f4a2cb0b35ad6eee991e5"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/ef58e682b96f4a2cb0b35ad6eee991e5"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/ef58e682b96f4a2cb0b35ad6eee991e5"}]}] Jun 06 13:14:41.120597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-TestMinimumBasicScenario-455638436 Jun 06 13:14:41.120597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: ef58e682b96f4a2cb0b35ad6eee991e5 Jun 06 13:14:41.120597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-TestMinimumBasicScenario-455638436 Jun 06 13:14:41.120597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-TestMinimumBasicScenario-455638436-project Jun 06 13:14:41.120597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:14:41.120597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:14:41.120597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: d6dad40e92684d1f95fc9b3b0a0337ed Jun 06 13:14:41.120597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-TestMinimumBasicScenario-455638436-project Jun 06 13:14:41.120597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:14:41.120597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance 87090e23-8967-41e3-93f5-2c475fe348cf could not be found. Jun 06 13:14:41.120597 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': '87090e23-8967-41e3-93f5-2c475fe348cf'} Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 87090e23-8967-41e3-93f5-2c475fe348cf could not be found. Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:14:41.121556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 87090e23-8967-41e3-93f5-2c475fe348cf could not be found. Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 87090e23-8967-41e3-93f5-2c475fe348cf could not be found. Jun 06 13:14:41.124063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:14:41.125598 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f1379649-f14b-4c5b-94ed-55f09c2861e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Returning 404 to user: Instance 87090e23-8967-41e3-93f5-2c475fe348cf could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:14:41.125598 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f1379649-f14b-4c5b-94ed-55f09c2861e1 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf" status: 404 len: 111 microversion: 2.1 time: 0.030450 Jun 06 13:14:41.125598 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 432/844] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:41 2022] GET /compute/v2.1/servers/87090e23-8967-41e3-93f5-2c475fe348cf => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 13:14:41.127710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5c6bc87e-ef19-477b-9476-9c6c3952e56a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:41.135835 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5c6bc87e-ef19-477b-9476-9c6c3952e56a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1450 microversion: 2.1 time: 0.161785 Jun 06 13:14:41.136018 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9191ac06-4211-4963-93c5-c2bc1d71b605 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] Calling method '.version_select at 0x7f0efc1f9940>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:41.136615 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 413/845] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:14:40 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1450 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:14:41.210657 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9191ac06-4211-4963-93c5-c2bc1d71b605 tempest-TestMinimumBasicScenario-455638436 tempest-TestMinimumBasicScenario-455638436-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-517416217" status: 202 len: 0 microversion: 2.1 time: 0.078426 Jun 06 13:14:41.211320 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 433/846] 10.222.0.13 () {58 vars in 1268 bytes} [Mon Jun 6 13:14:41 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-517416217 => generated 0 bytes in 80 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:14:42.002510 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-48abb379-75a6-46f2-84ef-ec03b5b16775 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:42.003126 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-48abb379-75a6-46f2-84ef-ec03b5b16775 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:42.010406 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-48abb379-75a6-46f2-84ef-ec03b5b16775 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:42.010918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-48abb379-75a6-46f2-84ef-ec03b5b16775 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:42.011735 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-48abb379-75a6-46f2-84ef-ec03b5b16775 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:42.012202 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-48abb379-75a6-46f2-84ef-ec03b5b16775 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:42.237831 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-48abb379-75a6-46f2-84ef-ec03b5b16775 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:42.246547 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-48abb379-75a6-46f2-84ef-ec03b5b16775 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:42.249038 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-48abb379-75a6-46f2-84ef-ec03b5b16775 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:42.250206 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-48abb379-75a6-46f2-84ef-ec03b5b16775 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.252836 Jun 06 13:14:42.250774 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 414/847] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:41 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:43.270303 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1dc00d42-67bb-438d-837a-65e9de7cb386 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:43.271760 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1dc00d42-67bb-438d-837a-65e9de7cb386 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:43.279286 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1dc00d42-67bb-438d-837a-65e9de7cb386 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:43.280460 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1dc00d42-67bb-438d-837a-65e9de7cb386 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:43.281439 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1dc00d42-67bb-438d-837a-65e9de7cb386 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:43.281881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1dc00d42-67bb-438d-837a-65e9de7cb386 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:43.503890 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1dc00d42-67bb-438d-837a-65e9de7cb386 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:43.515344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1dc00d42-67bb-438d-837a-65e9de7cb386 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:43.517745 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1dc00d42-67bb-438d-837a-65e9de7cb386 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:43.519382 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1dc00d42-67bb-438d-837a-65e9de7cb386 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1744 microversion: 2.20 time: 0.254054 Jun 06 13:14:43.532055 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 434/848] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:43 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1744 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:43.697864 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-d06c5069-447f-41cf-be5c-cd8c1cf4bcf3 req-cb6e0749-3b88-4e2c-989c-4de1a37b0a9c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "787b0a77-8cba-4834-98e8-4524ac3e03d7", "tag": "0bb1b662-7ea0-4f9a-b1f3-e9c46704c25e"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:43.709700 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-d06c5069-447f-41cf-be5c-cd8c1cf4bcf3 req-cb6e0749-3b88-4e2c-989c-4de1a37b0a9c service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:43.710487 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-d06c5069-447f-41cf-be5c-cd8c1cf4bcf3 req-cb6e0749-3b88-4e2c-989c-4de1a37b0a9c service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:43.734602 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-d06c5069-447f-41cf-be5c-cd8c1cf4bcf3 req-cb6e0749-3b88-4e2c-989c-4de1a37b0a9c service nova] Creating event network-changed:0bb1b662-7ea0-4f9a-b1f3-e9c46704c25e for instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 on hv-cinder-75510 Jun 06 13:14:43.749916 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-d06c5069-447f-41cf-be5c-cd8c1cf4bcf3 req-cb6e0749-3b88-4e2c-989c-4de1a37b0a9c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.056139 Jun 06 13:14:43.750523 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 415/849] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:14:44.539142 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fbe6e7c8-f606-4462-9064-376d08126939 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:44.539997 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fbe6e7c8-f606-4462-9064-376d08126939 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:44.543856 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=96,nova_api:INSERT=3,nova_api:DELETE=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:44.549704 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fbe6e7c8-f606-4462-9064-376d08126939 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:44.550336 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fbe6e7c8-f606-4462-9064-376d08126939 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:44.551166 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fbe6e7c8-f606-4462-9064-376d08126939 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:44.551621 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fbe6e7c8-f606-4462-9064-376d08126939 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:44.735149 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fbe6e7c8-f606-4462-9064-376d08126939 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:44.743782 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fbe6e7c8-f606-4462-9064-376d08126939 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:44.745351 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fbe6e7c8-f606-4462-9064-376d08126939 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:44.746629 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fbe6e7c8-f606-4462-9064-376d08126939 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1744 microversion: 2.20 time: 0.211913 Jun 06 13:14:44.757253 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 435/850] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:44 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1744 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:45.768218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a5b1b737-1ebd-426a-9831-9403e9f25469 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:45.769163 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a5b1b737-1ebd-426a-9831-9403e9f25469 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:45.778320 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5b1b737-1ebd-426a-9831-9403e9f25469 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:45.779130 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5b1b737-1ebd-426a-9831-9403e9f25469 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:45.780324 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5b1b737-1ebd-426a-9831-9403e9f25469 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:45.781399 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5b1b737-1ebd-426a-9831-9403e9f25469 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:46.001698 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a5b1b737-1ebd-426a-9831-9403e9f25469 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:46.010809 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a5b1b737-1ebd-426a-9831-9403e9f25469 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:46.017473 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a5b1b737-1ebd-426a-9831-9403e9f25469 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:46.017473 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a5b1b737-1ebd-426a-9831-9403e9f25469 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1739 microversion: 2.20 time: 0.253366 Jun 06 13:14:46.017473 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 416/851] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:45 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1739 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:46.802147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-bbdf7614-01e3-4674-8cf8-0d9a7eda887a req-6ee84aa2-42f4-46e4-8dd5-bcb2165eeb91 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e", "name": "network-vif-plugged", "status": "completed", "tag": "ec8a25f8-dea4-4bfd-9075-104851367737"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:46.818776 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-bbdf7614-01e3-4674-8cf8-0d9a7eda887a req-6ee84aa2-42f4-46e4-8dd5-bcb2165eeb91 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:46.825191 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-bbdf7614-01e3-4674-8cf8-0d9a7eda887a req-6ee84aa2-42f4-46e4-8dd5-bcb2165eeb91 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:46.839231 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-bbdf7614-01e3-4674-8cf8-0d9a7eda887a req-6ee84aa2-42f4-46e4-8dd5-bcb2165eeb91 service nova] Creating event network-vif-plugged:ec8a25f8-dea4-4bfd-9075-104851367737 for instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e on hv-cinder-75510 Jun 06 13:14:46.845530 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-bbdf7614-01e3-4674-8cf8-0d9a7eda887a req-6ee84aa2-42f4-46e4-8dd5-bcb2165eeb91 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.047446 Jun 06 13:14:46.846893 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 436/852] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:14:46 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:47.036419 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cbc2c349-b667-4a72-9bd0-1f909d108dd0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:47.037573 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-cbc2c349-b667-4a72-9bd0-1f909d108dd0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:47.054569 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cbc2c349-b667-4a72-9bd0-1f909d108dd0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:47.055272 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cbc2c349-b667-4a72-9bd0-1f909d108dd0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:47.059038 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cbc2c349-b667-4a72-9bd0-1f909d108dd0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:47.059845 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cbc2c349-b667-4a72-9bd0-1f909d108dd0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:47.381255 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cbc2c349-b667-4a72-9bd0-1f909d108dd0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:47.400052 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cbc2c349-b667-4a72-9bd0-1f909d108dd0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:47.405684 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cbc2c349-b667-4a72-9bd0-1f909d108dd0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:47.407232 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cbc2c349-b667-4a72-9bd0-1f909d108dd0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1739 microversion: 2.20 time: 0.376907 Jun 06 13:14:47.410136 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 417/853] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:47 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1739 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:48.429506 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f3ed3042-f051-42ad-9dc0-6f1d722f40f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:48.430207 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f3ed3042-f051-42ad-9dc0-6f1d722f40f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:48.443814 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f3ed3042-f051-42ad-9dc0-6f1d722f40f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:48.444473 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f3ed3042-f051-42ad-9dc0-6f1d722f40f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:48.445447 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f3ed3042-f051-42ad-9dc0-6f1d722f40f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:48.446081 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f3ed3042-f051-42ad-9dc0-6f1d722f40f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:49.028435 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f3ed3042-f051-42ad-9dc0-6f1d722f40f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:49.040599 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f3ed3042-f051-42ad-9dc0-6f1d722f40f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:49.043839 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f3ed3042-f051-42ad-9dc0-6f1d722f40f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:49.050423 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f3ed3042-f051-42ad-9dc0-6f1d722f40f9 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1739 microversion: 2.20 time: 0.621223 Jun 06 13:14:49.050423 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 437/854] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:48 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1739 bytes in 623 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:50.064674 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-edb1d047-6a9e-4b12-b28d-bd8b22a8b07b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:50.065322 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-edb1d047-6a9e-4b12-b28d-bd8b22a8b07b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:50.069155 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:INSERT=3,nova_api:SELECT=80,nova_api:UPDATE=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:50.072995 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-edb1d047-6a9e-4b12-b28d-bd8b22a8b07b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:50.073435 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-edb1d047-6a9e-4b12-b28d-bd8b22a8b07b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:50.074411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-edb1d047-6a9e-4b12-b28d-bd8b22a8b07b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:50.074655 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-edb1d047-6a9e-4b12-b28d-bd8b22a8b07b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:50.227945 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-edb1d047-6a9e-4b12-b28d-bd8b22a8b07b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:50.237600 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-edb1d047-6a9e-4b12-b28d-bd8b22a8b07b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:50.239214 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-edb1d047-6a9e-4b12-b28d-bd8b22a8b07b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:50.240524 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-edb1d047-6a9e-4b12-b28d-bd8b22a8b07b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1739 microversion: 2.20 time: 0.180701 Jun 06 13:14:50.241080 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 418/855] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:50 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1739 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:51.259588 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4b532345-199a-4c7c-8bf1-324ec2603cbc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:51.261510 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4b532345-199a-4c7c-8bf1-324ec2603cbc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:51.285265 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4b532345-199a-4c7c-8bf1-324ec2603cbc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:51.286173 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4b532345-199a-4c7c-8bf1-324ec2603cbc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:51.287511 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4b532345-199a-4c7c-8bf1-324ec2603cbc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:51.288463 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4b532345-199a-4c7c-8bf1-324ec2603cbc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:51.415714 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-db6cd91b-7628-4140-9cdc-b2f1aa54b658 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:51.417204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-db6cd91b-7628-4140-9cdc-b2f1aa54b658 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:51.427509 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-db6cd91b-7628-4140-9cdc-b2f1aa54b658 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:51.429192 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-db6cd91b-7628-4140-9cdc-b2f1aa54b658 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:51.430298 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-db6cd91b-7628-4140-9cdc-b2f1aa54b658 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:51.430988 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-db6cd91b-7628-4140-9cdc-b2f1aa54b658 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:51.465639 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-db6cd91b-7628-4140-9cdc-b2f1aa54b658 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/ips" status: 200 len: 145 microversion: 2.1 time: 0.054467 Jun 06 13:14:51.470157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 419/856] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 13:14:51 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/ips => generated 145 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:14:51.719000 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4b532345-199a-4c7c-8bf1-324ec2603cbc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:51.729166 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4b532345-199a-4c7c-8bf1-324ec2603cbc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:51.732171 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4b532345-199a-4c7c-8bf1-324ec2603cbc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:51.735965 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4b532345-199a-4c7c-8bf1-324ec2603cbc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1739 microversion: 2.20 time: 0.480067 Jun 06 13:14:51.737437 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 438/857] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:51 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1739 bytes in 482 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:52.755151 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-759869e3-99e7-43b7-8475-eb8afb4a4fdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:52.755784 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-759869e3-99e7-43b7-8475-eb8afb4a4fdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:52.764022 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-759869e3-99e7-43b7-8475-eb8afb4a4fdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:52.764807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-759869e3-99e7-43b7-8475-eb8afb4a4fdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:52.765625 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-759869e3-99e7-43b7-8475-eb8afb4a4fdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:52.766060 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-759869e3-99e7-43b7-8475-eb8afb4a4fdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:52.769318 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:52.975085 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-759869e3-99e7-43b7-8475-eb8afb4a4fdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:52.983396 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-759869e3-99e7-43b7-8475-eb8afb4a4fdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:52.985258 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-759869e3-99e7-43b7-8475-eb8afb4a4fdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:52.986772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-759869e3-99e7-43b7-8475-eb8afb4a4fdc tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1739 microversion: 2.20 time: 0.236260 Jun 06 13:14:52.997924 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 420/858] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:52 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1739 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:53.412617 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-41f0cfd6-c3b6-4608-a1d5-7b2e1b5f39c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "11baf575-d6e5-4235-8705-beb3515be77f"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:14:53.414340 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-41f0cfd6-c3b6-4608-a1d5-7b2e1b5f39c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:53.421758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41f0cfd6-c3b6-4608-a1d5-7b2e1b5f39c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:53.422414 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41f0cfd6-c3b6-4608-a1d5-7b2e1b5f39c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:53.423762 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41f0cfd6-c3b6-4608-a1d5-7b2e1b5f39c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:53.424557 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-41f0cfd6-c3b6-4608-a1d5-7b2e1b5f39c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:54.005317 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-dbf422a9-ee27-4c19-9fdf-7749acb496f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:54.006508 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-dbf422a9-ee27-4c19-9fdf-7749acb496f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:54.013082 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-dbf422a9-ee27-4c19-9fdf-7749acb496f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:54.014237 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-dbf422a9-ee27-4c19-9fdf-7749acb496f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:54.016221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-dbf422a9-ee27-4c19-9fdf-7749acb496f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:54.016791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-dbf422a9-ee27-4c19-9fdf-7749acb496f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:54.142756 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:14:54.213507 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-dbf422a9-ee27-4c19-9fdf-7749acb496f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:54.225272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-41f0cfd6-c3b6-4608-a1d5-7b2e1b5f39c4 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "POST /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.816403 Jun 06 13:14:54.225888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 439/859] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:14:53 2022] POST /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments => generated 194 bytes in 818 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:14:54.251735 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-dbf422a9-ee27-4c19-9fdf-7749acb496f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:54.251735 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-dbf422a9-ee27-4c19-9fdf-7749acb496f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:54.251735 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-dbf422a9-ee27-4c19-9fdf-7749acb496f0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1739 microversion: 2.20 time: 0.235810 Jun 06 13:14:54.252552 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 421/860] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:54 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1739 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:14:55.260207 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f5e08c69-15f2-484f-8ea7-481cf7fdde57 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:55.261510 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f5e08c69-15f2-484f-8ea7-481cf7fdde57 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:55.278878 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5e08c69-15f2-484f-8ea7-481cf7fdde57 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:55.282767 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5e08c69-15f2-484f-8ea7-481cf7fdde57 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:55.282767 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5e08c69-15f2-484f-8ea7-481cf7fdde57 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:55.283356 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5e08c69-15f2-484f-8ea7-481cf7fdde57 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:55.473500 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f5e08c69-15f2-484f-8ea7-481cf7fdde57 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:55.484568 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f5e08c69-15f2-484f-8ea7-481cf7fdde57 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:55.488408 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f5e08c69-15f2-484f-8ea7-481cf7fdde57 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:55.490279 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f5e08c69-15f2-484f-8ea7-481cf7fdde57 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1739 microversion: 2.20 time: 0.236383 Jun 06 13:14:55.493286 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 440/861] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:55 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1739 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:56.510507 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a94161ec-35bd-4bcc-93e0-ad46eee79dc3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:56.511115 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a94161ec-35bd-4bcc-93e0-ad46eee79dc3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:56.517685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a94161ec-35bd-4bcc-93e0-ad46eee79dc3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:56.518134 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a94161ec-35bd-4bcc-93e0-ad46eee79dc3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:56.519084 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a94161ec-35bd-4bcc-93e0-ad46eee79dc3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:56.519864 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a94161ec-35bd-4bcc-93e0-ad46eee79dc3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:56.689950 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a94161ec-35bd-4bcc-93e0-ad46eee79dc3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:56.697917 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a94161ec-35bd-4bcc-93e0-ad46eee79dc3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:56.699430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a94161ec-35bd-4bcc-93e0-ad46eee79dc3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:56.700615 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a94161ec-35bd-4bcc-93e0-ad46eee79dc3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1739 microversion: 2.20 time: 0.194303 Jun 06 13:14:56.712383 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 422/862] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:56 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1739 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:57.725239 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c66c1459-cc9b-47cb-a6a1-9e8d88f47152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:57.725928 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c66c1459-cc9b-47cb-a6a1-9e8d88f47152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:57.733141 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c66c1459-cc9b-47cb-a6a1-9e8d88f47152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:57.733682 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c66c1459-cc9b-47cb-a6a1-9e8d88f47152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:57.734560 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c66c1459-cc9b-47cb-a6a1-9e8d88f47152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:57.735072 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c66c1459-cc9b-47cb-a6a1-9e8d88f47152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:57.872188 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c66c1459-cc9b-47cb-a6a1-9e8d88f47152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:57.881434 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c66c1459-cc9b-47cb-a6a1-9e8d88f47152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:57.883407 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c66c1459-cc9b-47cb-a6a1-9e8d88f47152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:57.896685 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c66c1459-cc9b-47cb-a6a1-9e8d88f47152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1739 microversion: 2.20 time: 0.168723 Jun 06 13:14:57.896685 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 441/863] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:57 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1739 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:14:58.904947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-75ad15a9-7670-4abe-bc50-4927638a266f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:14:58.905559 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-75ad15a9-7670-4abe-bc50-4927638a266f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:14:58.912371 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-75ad15a9-7670-4abe-bc50-4927638a266f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:58.912822 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-75ad15a9-7670-4abe-bc50-4927638a266f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:58.913598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-75ad15a9-7670-4abe-bc50-4927638a266f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:14:58.914034 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-75ad15a9-7670-4abe-bc50-4927638a266f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:14:59.052448 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-75ad15a9-7670-4abe-bc50-4927638a266f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:59.060370 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-75ad15a9-7670-4abe-bc50-4927638a266f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:59.063031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-75ad15a9-7670-4abe-bc50-4927638a266f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:14:59.064343 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-75ad15a9-7670-4abe-bc50-4927638a266f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1739 microversion: 2.20 time: 0.163860 Jun 06 13:14:59.065118 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 423/864] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:14:58 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1739 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:00.083513 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-af8478fd-fd17-4467-9d80-27557bec0fba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:00.084144 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-af8478fd-fd17-4467-9d80-27557bec0fba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:00.090624 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af8478fd-fd17-4467-9d80-27557bec0fba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:00.091073 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af8478fd-fd17-4467-9d80-27557bec0fba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:00.091877 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af8478fd-fd17-4467-9d80-27557bec0fba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:00.093052 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-af8478fd-fd17-4467-9d80-27557bec0fba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:00.228606 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-af8478fd-fd17-4467-9d80-27557bec0fba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:00.237316 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-af8478fd-fd17-4467-9d80-27557bec0fba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:00.238805 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-af8478fd-fd17-4467-9d80-27557bec0fba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:00.239990 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-af8478fd-fd17-4467-9d80-27557bec0fba tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1721 microversion: 2.20 time: 0.160565 Jun 06 13:15:00.240546 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 442/865] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:00 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1721 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:01.258037 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ba48b443-7c61-4ce2-96fa-c04bc5746e19 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:01.258849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ba48b443-7c61-4ce2-96fa-c04bc5746e19 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:01.265944 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ba48b443-7c61-4ce2-96fa-c04bc5746e19 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:01.266388 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ba48b443-7c61-4ce2-96fa-c04bc5746e19 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:01.267149 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ba48b443-7c61-4ce2-96fa-c04bc5746e19 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:01.267606 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ba48b443-7c61-4ce2-96fa-c04bc5746e19 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:01.399767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ba48b443-7c61-4ce2-96fa-c04bc5746e19 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:01.409038 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ba48b443-7c61-4ce2-96fa-c04bc5746e19 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:01.410760 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ba48b443-7c61-4ce2-96fa-c04bc5746e19 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:01.411878 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ba48b443-7c61-4ce2-96fa-c04bc5746e19 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1721 microversion: 2.20 time: 0.157688 Jun 06 13:15:01.412429 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 424/866] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:01 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1721 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:02.430478 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-55c8a900-ecb8-4e6b-8f9c-5f70d0562376 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:02.431087 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-55c8a900-ecb8-4e6b-8f9c-5f70d0562376 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:02.437928 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-55c8a900-ecb8-4e6b-8f9c-5f70d0562376 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:02.438378 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-55c8a900-ecb8-4e6b-8f9c-5f70d0562376 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:02.439169 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-55c8a900-ecb8-4e6b-8f9c-5f70d0562376 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:02.439627 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-55c8a900-ecb8-4e6b-8f9c-5f70d0562376 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:02.550321 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-317a2588-1871-4aac-8e17-70090e306c14 req-e1342f8e-dc99-4671-8675-08458dba9a9e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e", "name": "network-vif-unplugged", "status": "completed", "tag": "ec8a25f8-dea4-4bfd-9075-104851367737"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:15:02.559760 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-317a2588-1871-4aac-8e17-70090e306c14 req-e1342f8e-dc99-4671-8675-08458dba9a9e service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:02.560215 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-317a2588-1871-4aac-8e17-70090e306c14 req-e1342f8e-dc99-4671-8675-08458dba9a9e service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:02.571816 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-317a2588-1871-4aac-8e17-70090e306c14 req-e1342f8e-dc99-4671-8675-08458dba9a9e service nova] Creating event network-vif-unplugged:ec8a25f8-dea4-4bfd-9075-104851367737 for instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e on hv-cinder-75510 Jun 06 13:15:02.577101 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-317a2588-1871-4aac-8e17-70090e306c14 req-e1342f8e-dc99-4671-8675-08458dba9a9e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030664 Jun 06 13:15:02.578885 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 425/867] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:15:02 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:15:02.581304 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-55c8a900-ecb8-4e6b-8f9c-5f70d0562376 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:02.591706 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-55c8a900-ecb8-4e6b-8f9c-5f70d0562376 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:02.593204 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-55c8a900-ecb8-4e6b-8f9c-5f70d0562376 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:02.595327 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-55c8a900-ecb8-4e6b-8f9c-5f70d0562376 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1724 microversion: 2.20 time: 0.168664 Jun 06 13:15:02.596092 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 443/868] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:02 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:02.614195 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c24d3d06-1d8e-4a43-9791-cb61c20612c2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "64ed9450-4c78-4861-9367-b54a1fb3fbfb"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:15:02.615335 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c24d3d06-1d8e-4a43-9791-cb61c20612c2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:02.621879 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c24d3d06-1d8e-4a43-9791-cb61c20612c2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:02.622537 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c24d3d06-1d8e-4a43-9791-cb61c20612c2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:02.623315 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c24d3d06-1d8e-4a43-9791-cb61c20612c2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:02.623782 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c24d3d06-1d8e-4a43-9791-cb61c20612c2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:03.546632 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c24d3d06-1d8e-4a43-9791-cb61c20612c2 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "POST /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 0.937422 Jun 06 13:15:03.547778 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 426/869] 10.222.0.13 () {62 vars in 1363 bytes} [Mon Jun 6 13:15:02 2022] POST /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/os-volume_attachments => generated 188 bytes in 939 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Jun 06 13:15:03.661696 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-882e01d6-9e1f-4351-9ec9-9947027ed076 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:03.662177 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-882e01d6-9e1f-4351-9ec9-9947027ed076 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:03.668959 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-882e01d6-9e1f-4351-9ec9-9947027ed076 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:03.669402 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-882e01d6-9e1f-4351-9ec9-9947027ed076 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:03.670242 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-882e01d6-9e1f-4351-9ec9-9947027ed076 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:03.670663 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-882e01d6-9e1f-4351-9ec9-9947027ed076 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:03.911073 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fe3e1ce2-4708-42fd-9754-c656ed4a5c3c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:03.912092 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-fe3e1ce2-4708-42fd-9754-c656ed4a5c3c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:03.920578 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe3e1ce2-4708-42fd-9754-c656ed4a5c3c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:03.921012 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe3e1ce2-4708-42fd-9754-c656ed4a5c3c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:03.925464 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe3e1ce2-4708-42fd-9754-c656ed4a5c3c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:03.925464 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe3e1ce2-4708-42fd-9754-c656ed4a5c3c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:03.956256 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-fe3e1ce2-4708-42fd-9754-c656ed4a5c3c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.051629 Jun 06 13:15:03.956826 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 427/870] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:15:03 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments => generated 197 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:15:03.966695 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-76547f73-a9d9-4e90-b013-a667995baf4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:03.967188 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-76547f73-a9d9-4e90-b013-a667995baf4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:03.973204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-76547f73-a9d9-4e90-b013-a667995baf4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:03.973661 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-76547f73-a9d9-4e90-b013-a667995baf4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:03.982760 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-76547f73-a9d9-4e90-b013-a667995baf4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:03.982760 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-76547f73-a9d9-4e90-b013-a667995baf4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:04.004013 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-76547f73-a9d9-4e90-b013-a667995baf4b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments/11baf575-d6e5-4235-8705-beb3515be77f" status: 200 len: 194 microversion: 2.1 time: 0.041099 Jun 06 13:15:04.004621 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 428/871] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Jun 6 13:15:03 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments/11baf575-d6e5-4235-8705-beb3515be77f => generated 194 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:15:04.392091 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-882e01d6-9e1f-4351-9ec9-9947027ed076 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "DELETE /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/os-volume_attachments/64ed9450-4c78-4861-9367-b54a1fb3fbfb" status: 202 len: 0 microversion: 2.20 time: 0.734210 Jun 06 13:15:04.404115 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 444/872] 10.222.0.13 () {60 vars in 1456 bytes} [Mon Jun 6 13:15:03 2022] DELETE /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/os-volume_attachments/64ed9450-4c78-4861-9367-b54a1fb3fbfb => generated 0 bytes in 736 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:15:04.454265 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a6f69ca5-a330-4aad-ba48-0dc88305e6e1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:15:04.454897 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a6f69ca5-a330-4aad-ba48-0dc88305e6e1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:04.461298 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a6f69ca5-a330-4aad-ba48-0dc88305e6e1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:04.461747 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a6f69ca5-a330-4aad-ba48-0dc88305e6e1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:04.462534 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a6f69ca5-a330-4aad-ba48-0dc88305e6e1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:04.462973 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a6f69ca5-a330-4aad-ba48-0dc88305e6e1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:04.749015 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a6f69ca5-a330-4aad-ba48-0dc88305e6e1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "POST /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/action" status: 202 len: 0 microversion: 2.20 time: 0.298908 Jun 06 13:15:04.749706 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 429/873] 10.222.0.13 () {62 vars in 1318 bytes} [Mon Jun 6 13:15:04 2022] POST /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/action => generated 0 bytes in 300 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:15:04.758731 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-30440150-35e5-4632-9b57-f61ce85e5a2d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:04.759346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-30440150-35e5-4632-9b57-f61ce85e5a2d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:04.766314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-30440150-35e5-4632-9b57-f61ce85e5a2d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:04.767113 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-30440150-35e5-4632-9b57-f61ce85e5a2d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:04.767933 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-30440150-35e5-4632-9b57-f61ce85e5a2d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:04.768373 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-30440150-35e5-4632-9b57-f61ce85e5a2d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:04.977050 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-30440150-35e5-4632-9b57-f61ce85e5a2d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:04.985615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-30440150-35e5-4632-9b57-f61ce85e5a2d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:04.987166 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-30440150-35e5-4632-9b57-f61ce85e5a2d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:04.988580 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-30440150-35e5-4632-9b57-f61ce85e5a2d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1672 microversion: 2.20 time: 0.234061 Jun 06 13:15:04.989146 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 445/874] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:04 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1672 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:05.949661 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-8e6d4611-dc56-43fe-9ff9-a78297fc5824 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "6e486da5-328b-40ee-9f86-c299d72bdd05"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:15:05.949661 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8e6d4611-dc56-43fe-9ff9-a78297fc5824 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:05.959888 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8e6d4611-dc56-43fe-9ff9-a78297fc5824 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:05.960335 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8e6d4611-dc56-43fe-9ff9-a78297fc5824 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:05.961360 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8e6d4611-dc56-43fe-9ff9-a78297fc5824 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:05.961706 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8e6d4611-dc56-43fe-9ff9-a78297fc5824 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:06.009814 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f2305bfd-1107-44f9-a6eb-4a62ca50d59c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:06.009814 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f2305bfd-1107-44f9-a6eb-4a62ca50d59c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:06.016728 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f2305bfd-1107-44f9-a6eb-4a62ca50d59c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:06.017410 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f2305bfd-1107-44f9-a6eb-4a62ca50d59c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:06.018437 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f2305bfd-1107-44f9-a6eb-4a62ca50d59c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:06.018946 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f2305bfd-1107-44f9-a6eb-4a62ca50d59c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:06.164154 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f2305bfd-1107-44f9-a6eb-4a62ca50d59c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:06.172892 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f2305bfd-1107-44f9-a6eb-4a62ca50d59c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:06.174505 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f2305bfd-1107-44f9-a6eb-4a62ca50d59c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:06.175738 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f2305bfd-1107-44f9-a6eb-4a62ca50d59c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1674 microversion: 2.20 time: 0.172244 Jun 06 13:15:06.176303 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 446/875] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:06 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1674 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:06.688760 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-8e6d4611-dc56-43fe-9ff9-a78297fc5824 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "POST /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.749096 Jun 06 13:15:06.689633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 430/876] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:15:05 2022] POST /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments => generated 194 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:15:07.193977 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d0489e42-116d-42c1-a0e3-9d3ef2bce4f5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:07.194540 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d0489e42-116d-42c1-a0e3-9d3ef2bce4f5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:07.201045 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0489e42-116d-42c1-a0e3-9d3ef2bce4f5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:07.201527 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0489e42-116d-42c1-a0e3-9d3ef2bce4f5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:07.202287 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0489e42-116d-42c1-a0e3-9d3ef2bce4f5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:07.202723 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0489e42-116d-42c1-a0e3-9d3ef2bce4f5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:07.345243 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0489e42-116d-42c1-a0e3-9d3ef2bce4f5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:07.354021 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0489e42-116d-42c1-a0e3-9d3ef2bce4f5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:07.356123 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0489e42-116d-42c1-a0e3-9d3ef2bce4f5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:07.361286 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d0489e42-116d-42c1-a0e3-9d3ef2bce4f5 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.167457 Jun 06 13:15:07.361286 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 447/877] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:07 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:08.379598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-13518234-9c1e-4995-871f-dd2925b081fe tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:08.381740 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-13518234-9c1e-4995-871f-dd2925b081fe tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:08.388942 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-13518234-9c1e-4995-871f-dd2925b081fe tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:08.392738 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-13518234-9c1e-4995-871f-dd2925b081fe tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:08.393588 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-13518234-9c1e-4995-871f-dd2925b081fe tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:08.394032 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-13518234-9c1e-4995-871f-dd2925b081fe tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:08.561074 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-13518234-9c1e-4995-871f-dd2925b081fe tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:08.569295 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-13518234-9c1e-4995-871f-dd2925b081fe tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:08.570819 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-13518234-9c1e-4995-871f-dd2925b081fe tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:08.572000 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-13518234-9c1e-4995-871f-dd2925b081fe tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.197960 Jun 06 13:15:08.572556 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 431/878] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:08 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:15:09.592083 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b099a177-da56-4063-8b69-236853c2600d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:09.593336 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b099a177-da56-4063-8b69-236853c2600d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:09.600544 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b099a177-da56-4063-8b69-236853c2600d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:09.601259 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b099a177-da56-4063-8b69-236853c2600d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:09.602286 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b099a177-da56-4063-8b69-236853c2600d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:09.602881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b099a177-da56-4063-8b69-236853c2600d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:09.747992 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b099a177-da56-4063-8b69-236853c2600d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:09.760807 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b099a177-da56-4063-8b69-236853c2600d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:09.762642 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b099a177-da56-4063-8b69-236853c2600d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:09.763859 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b099a177-da56-4063-8b69-236853c2600d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.176620 Jun 06 13:15:09.764414 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 448/879] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:09 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:10.782229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f1e4064e-54f3-4664-a19f-4d30fd9dabdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:10.782840 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f1e4064e-54f3-4664-a19f-4d30fd9dabdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:10.789450 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f1e4064e-54f3-4664-a19f-4d30fd9dabdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:10.789900 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f1e4064e-54f3-4664-a19f-4d30fd9dabdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:10.790665 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f1e4064e-54f3-4664-a19f-4d30fd9dabdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:10.791100 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f1e4064e-54f3-4664-a19f-4d30fd9dabdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:10.809061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=88,nova_cell1:INSERT=5,nova_cell1:UPDATE=7 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:10.948002 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f1e4064e-54f3-4664-a19f-4d30fd9dabdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:10.958466 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f1e4064e-54f3-4664-a19f-4d30fd9dabdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:10.960457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f1e4064e-54f3-4664-a19f-4d30fd9dabdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:10.962646 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f1e4064e-54f3-4664-a19f-4d30fd9dabdf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.184134 Jun 06 13:15:10.973304 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 432/880] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:10 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:11.907433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fa2569a4-92ab-4196-bbc5-5f52c88e7fa3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:11.908107 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fa2569a4-92ab-4196-bbc5-5f52c88e7fa3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:11.914529 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa2569a4-92ab-4196-bbc5-5f52c88e7fa3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:11.920201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa2569a4-92ab-4196-bbc5-5f52c88e7fa3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:11.920201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa2569a4-92ab-4196-bbc5-5f52c88e7fa3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:11.920201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa2569a4-92ab-4196-bbc5-5f52c88e7fa3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:11.941902 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fa2569a4-92ab-4196-bbc5-5f52c88e7fa3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/ips" status: 200 len: 150 microversion: 2.1 time: 0.038986 Jun 06 13:15:11.942869 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 449/881] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 13:15:11 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/ips => generated 150 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:15:11.982137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-496a5e19-9ddf-4f61-bf96-76dcc64c4634 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:11.982754 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-496a5e19-9ddf-4f61-bf96-76dcc64c4634 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:11.990297 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-496a5e19-9ddf-4f61-bf96-76dcc64c4634 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:11.991083 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-496a5e19-9ddf-4f61-bf96-76dcc64c4634 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:11.992172 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-496a5e19-9ddf-4f61-bf96-76dcc64c4634 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:11.992850 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-496a5e19-9ddf-4f61-bf96-76dcc64c4634 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:12.175316 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-496a5e19-9ddf-4f61-bf96-76dcc64c4634 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:12.183543 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-496a5e19-9ddf-4f61-bf96-76dcc64c4634 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:12.185326 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-496a5e19-9ddf-4f61-bf96-76dcc64c4634 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:12.186480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-496a5e19-9ddf-4f61-bf96-76dcc64c4634 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.208198 Jun 06 13:15:12.187451 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 433/882] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:11 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:13.206410 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ca071ccb-ec34-41d0-b2d0-b3ec3ca94408 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:13.206950 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ca071ccb-ec34-41d0-b2d0-b3ec3ca94408 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:13.213849 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca071ccb-ec34-41d0-b2d0-b3ec3ca94408 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:13.214471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca071ccb-ec34-41d0-b2d0-b3ec3ca94408 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:13.215228 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca071ccb-ec34-41d0-b2d0-b3ec3ca94408 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:13.215683 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca071ccb-ec34-41d0-b2d0-b3ec3ca94408 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:13.359270 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ca071ccb-ec34-41d0-b2d0-b3ec3ca94408 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:13.371004 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ca071ccb-ec34-41d0-b2d0-b3ec3ca94408 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:13.376773 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ca071ccb-ec34-41d0-b2d0-b3ec3ca94408 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:13.376773 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ca071ccb-ec34-41d0-b2d0-b3ec3ca94408 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.171884 Jun 06 13:15:13.376773 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 450/883] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:13 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:13.559222 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5828fe73-75ee-4f37-a5b2-b2f30a348597 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "110239af-af5b-4d5f-80e5-0c523d5cad07"}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:15:13.561521 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5828fe73-75ee-4f37-a5b2-b2f30a348597 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:13.575806 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5828fe73-75ee-4f37-a5b2-b2f30a348597 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:13.576507 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5828fe73-75ee-4f37-a5b2-b2f30a348597 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:13.577682 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5828fe73-75ee-4f37-a5b2-b2f30a348597 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:13.578547 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5828fe73-75ee-4f37-a5b2-b2f30a348597 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:14.394726 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a6bcf5fd-fae8-42df-a18b-a488df6dcffa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:14.395355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a6bcf5fd-fae8-42df-a18b-a488df6dcffa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:14.404743 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a6bcf5fd-fae8-42df-a18b-a488df6dcffa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:14.405502 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a6bcf5fd-fae8-42df-a18b-a488df6dcffa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:14.406283 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a6bcf5fd-fae8-42df-a18b-a488df6dcffa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:14.407166 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a6bcf5fd-fae8-42df-a18b-a488df6dcffa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:14.553054 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a6bcf5fd-fae8-42df-a18b-a488df6dcffa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:14.562179 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a6bcf5fd-fae8-42df-a18b-a488df6dcffa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:14.564473 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a6bcf5fd-fae8-42df-a18b-a488df6dcffa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:14.565938 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a6bcf5fd-fae8-42df-a18b-a488df6dcffa tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.175911 Jun 06 13:15:14.579658 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 451/884] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:14 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:15.597657 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3bfbaf23-d325-4dc4-8c12-047419cae011 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:15.598341 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3bfbaf23-d325-4dc4-8c12-047419cae011 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:15.605154 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3bfbaf23-d325-4dc4-8c12-047419cae011 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:15.605606 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3bfbaf23-d325-4dc4-8c12-047419cae011 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:15.606382 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3bfbaf23-d325-4dc4-8c12-047419cae011 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:15.607070 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3bfbaf23-d325-4dc4-8c12-047419cae011 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:15.757300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3bfbaf23-d325-4dc4-8c12-047419cae011 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:15.765727 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3bfbaf23-d325-4dc4-8c12-047419cae011 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:15.768211 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3bfbaf23-d325-4dc4-8c12-047419cae011 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:15.769433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3bfbaf23-d325-4dc4-8c12-047419cae011 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.176576 Jun 06 13:15:15.770000 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 452/885] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:15 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:15:16.789284 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9f07668b-c210-4192-a514-f5c3a4bf7553 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:16.789902 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9f07668b-c210-4192-a514-f5c3a4bf7553 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:16.799771 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f07668b-c210-4192-a514-f5c3a4bf7553 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:16.799771 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f07668b-c210-4192-a514-f5c3a4bf7553 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:16.799771 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f07668b-c210-4192-a514-f5c3a4bf7553 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:16.799771 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9f07668b-c210-4192-a514-f5c3a4bf7553 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:16.932497 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9f07668b-c210-4192-a514-f5c3a4bf7553 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:16.940859 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9f07668b-c210-4192-a514-f5c3a4bf7553 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:16.942389 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9f07668b-c210-4192-a514-f5c3a4bf7553 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:16.943600 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9f07668b-c210-4192-a514-f5c3a4bf7553 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.158385 Jun 06 13:15:16.944163 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 453/886] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:16 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:17.962804 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e38a9474-05cf-4df7-915a-a15ab37be4c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:17.963573 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e38a9474-05cf-4df7-915a-a15ab37be4c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:17.966270 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=38 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:17.971699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e38a9474-05cf-4df7-915a-a15ab37be4c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:17.977243 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e38a9474-05cf-4df7-915a-a15ab37be4c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:17.977243 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e38a9474-05cf-4df7-915a-a15ab37be4c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:17.977243 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e38a9474-05cf-4df7-915a-a15ab37be4c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:17.977243 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:INSERT=3,nova_cell1:SELECT=93,nova_cell1:UPDATE=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:18.109372 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e38a9474-05cf-4df7-915a-a15ab37be4c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:18.117946 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e38a9474-05cf-4df7-915a-a15ab37be4c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:18.119475 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e38a9474-05cf-4df7-915a-a15ab37be4c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:18.120662 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e38a9474-05cf-4df7-915a-a15ab37be4c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.162063 Jun 06 13:15:18.121223 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 454/887] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:17 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:15:18.912161 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5828fe73-75ee-4f37-a5b2-b2f30a348597 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "POST /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 5.357736 Jun 06 13:15:18.917006 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 434/888] 10.222.0.13 () {60 vars in 1322 bytes} [Mon Jun 6 13:15:13 2022] POST /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 194 bytes in 5359 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:15:19.138598 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-02cfe9ee-6433-400b-8487-adccdc9001d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:19.139351 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-02cfe9ee-6433-400b-8487-adccdc9001d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:19.146109 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-02cfe9ee-6433-400b-8487-adccdc9001d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:19.146560 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-02cfe9ee-6433-400b-8487-adccdc9001d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:19.147331 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-02cfe9ee-6433-400b-8487-adccdc9001d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:19.147804 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-02cfe9ee-6433-400b-8487-adccdc9001d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:19.289016 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-02cfe9ee-6433-400b-8487-adccdc9001d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:19.297459 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-02cfe9ee-6433-400b-8487-adccdc9001d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:19.299647 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-02cfe9ee-6433-400b-8487-adccdc9001d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:19.305665 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-02cfe9ee-6433-400b-8487-adccdc9001d4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.166150 Jun 06 13:15:19.305665 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 455/889] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:19 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:19.553459 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b7bc324d-755d-48c7-9994-f1480921cbb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:19.554479 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b7bc324d-755d-48c7-9994-f1480921cbb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:19.561807 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b7bc324d-755d-48c7-9994-f1480921cbb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:19.562262 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b7bc324d-755d-48c7-9994-f1480921cbb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:19.563028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b7bc324d-755d-48c7-9994-f1480921cbb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:19.563464 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b7bc324d-755d-48c7-9994-f1480921cbb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:19.593173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b7bc324d-755d-48c7-9994-f1480921cbb1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.044737 Jun 06 13:15:19.593736 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 435/890] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:15:19 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments => generated 371 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:15:19.739738 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-218af431-8fc6-4100-91a8-0244b3d4d984 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:19.740137 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-218af431-8fc6-4100-91a8-0244b3d4d984 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:19.746216 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-218af431-8fc6-4100-91a8-0244b3d4d984 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:19.746667 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-218af431-8fc6-4100-91a8-0244b3d4d984 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:19.747430 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-218af431-8fc6-4100-91a8-0244b3d4d984 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:19.747936 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-218af431-8fc6-4100-91a8-0244b3d4d984 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:19.777007 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-218af431-8fc6-4100-91a8-0244b3d4d984 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments/11baf575-d6e5-4235-8705-beb3515be77f" status: 200 len: 194 microversion: 2.1 time: 0.042556 Jun 06 13:15:19.777582 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 456/891] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Jun 6 13:15:19 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments/11baf575-d6e5-4235-8705-beb3515be77f => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:15:19.787796 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-749a4403-2d39-4e90-a6e7-cb539d1a20fa tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:19.788297 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-749a4403-2d39-4e90-a6e7-cb539d1a20fa tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:19.794333 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-749a4403-2d39-4e90-a6e7-cb539d1a20fa tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:19.795057 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-749a4403-2d39-4e90-a6e7-cb539d1a20fa tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:19.795846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-749a4403-2d39-4e90-a6e7-cb539d1a20fa tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:19.796306 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-749a4403-2d39-4e90-a6e7-cb539d1a20fa tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:19.880927 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-749a4403-2d39-4e90-a6e7-cb539d1a20fa tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lazy-loading 'services' on Instance uuid 1ff2f700-fdee-4fd2-a53f-92620522ffb2 {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:15:20.319747 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-74ae43b0-3c9e-4b89-8eb1-af33e1006c63 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:20.392900 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-74ae43b0-3c9e-4b89-8eb1-af33e1006c63 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:20.392900 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74ae43b0-3c9e-4b89-8eb1-af33e1006c63 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:20.392900 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74ae43b0-3c9e-4b89-8eb1-af33e1006c63 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:20.392900 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74ae43b0-3c9e-4b89-8eb1-af33e1006c63 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:20.393362 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-74ae43b0-3c9e-4b89-8eb1-af33e1006c63 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:20.469842 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-74ae43b0-3c9e-4b89-8eb1-af33e1006c63 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:20.487343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-74ae43b0-3c9e-4b89-8eb1-af33e1006c63 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:20.489238 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-74ae43b0-3c9e-4b89-8eb1-af33e1006c63 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:20.490588 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-74ae43b0-3c9e-4b89-8eb1-af33e1006c63 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.174828 Jun 06 13:15:20.502086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 457/892] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:20 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:15:20.763457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-749a4403-2d39-4e90-a6e7-cb539d1a20fa tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments/11baf575-d6e5-4235-8705-beb3515be77f" status: 202 len: 0 microversion: 2.1 time: 0.979506 Jun 06 13:15:20.764073 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 436/893] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 13:15:19 2022] DELETE /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments/11baf575-d6e5-4235-8705-beb3515be77f => generated 0 bytes in 981 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:15:21.509902 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0d761a02-f869-4147-8b26-e3ce601f952e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:21.510516 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0d761a02-f869-4147-8b26-e3ce601f952e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:21.517600 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0d761a02-f869-4147-8b26-e3ce601f952e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:21.518213 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0d761a02-f869-4147-8b26-e3ce601f952e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:21.518977 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0d761a02-f869-4147-8b26-e3ce601f952e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:21.519413 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0d761a02-f869-4147-8b26-e3ce601f952e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:21.654989 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0d761a02-f869-4147-8b26-e3ce601f952e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:21.663084 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0d761a02-f869-4147-8b26-e3ce601f952e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:21.664771 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0d761a02-f869-4147-8b26-e3ce601f952e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:21.665998 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0d761a02-f869-4147-8b26-e3ce601f952e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.160029 Jun 06 13:15:21.666546 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 458/894] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:21 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:22.653633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-be7e31a6-130a-4212-9556-b448fc79d788 req-b25726d4-d1e8-4657-80af-7ea09213af71 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e", "name": "network-vif-plugged", "status": "completed", "tag": "ec8a25f8-dea4-4bfd-9075-104851367737"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:15:22.662114 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-be7e31a6-130a-4212-9556-b448fc79d788 req-b25726d4-d1e8-4657-80af-7ea09213af71 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:22.673070 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-be7e31a6-130a-4212-9556-b448fc79d788 req-b25726d4-d1e8-4657-80af-7ea09213af71 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:22.673454 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-be7e31a6-130a-4212-9556-b448fc79d788 req-b25726d4-d1e8-4657-80af-7ea09213af71 service nova] Creating event network-vif-plugged:ec8a25f8-dea4-4bfd-9075-104851367737 for instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e on hv-cinder-75510 Jun 06 13:15:22.678978 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-be7e31a6-130a-4212-9556-b448fc79d788 req-b25726d4-d1e8-4657-80af-7ea09213af71 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030007 Jun 06 13:15:22.679595 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 437/895] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:15:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:15:22.684576 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-12d53763-0ab5-4fbf-8cd4-f3c9e6faf0c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:22.685176 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-12d53763-0ab5-4fbf-8cd4-f3c9e6faf0c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:22.693159 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12d53763-0ab5-4fbf-8cd4-f3c9e6faf0c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:22.693655 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12d53763-0ab5-4fbf-8cd4-f3c9e6faf0c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:22.694413 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12d53763-0ab5-4fbf-8cd4-f3c9e6faf0c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:22.694843 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-12d53763-0ab5-4fbf-8cd4-f3c9e6faf0c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:22.840772 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-12d53763-0ab5-4fbf-8cd4-f3c9e6faf0c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:22.849327 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-12d53763-0ab5-4fbf-8cd4-f3c9e6faf0c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:22.850824 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-12d53763-0ab5-4fbf-8cd4-f3c9e6faf0c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:22.852225 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-12d53763-0ab5-4fbf-8cd4-f3c9e6faf0c6 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.171719 Jun 06 13:15:22.852955 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 459/896] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:22 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Jun 06 13:15:23.872393 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-613a7312-b560-4bfe-8c8b-259efe11aa84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:23.873075 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-613a7312-b560-4bfe-8c8b-259efe11aa84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:23.875046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=42 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:23.880127 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-613a7312-b560-4bfe-8c8b-259efe11aa84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:23.881146 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-613a7312-b560-4bfe-8c8b-259efe11aa84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:23.881505 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-613a7312-b560-4bfe-8c8b-259efe11aa84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:23.881937 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-613a7312-b560-4bfe-8c8b-259efe11aa84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:24.021785 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-613a7312-b560-4bfe-8c8b-259efe11aa84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:24.029834 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-613a7312-b560-4bfe-8c8b-259efe11aa84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:24.031416 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-613a7312-b560-4bfe-8c8b-259efe11aa84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:24.033087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-613a7312-b560-4bfe-8c8b-259efe11aa84 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.164896 Jun 06 13:15:24.033652 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 438/897] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:23 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:25.051477 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9870437d-7bc1-43d1-bc6e-13a71dde6cf3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:25.052115 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9870437d-7bc1-43d1-bc6e-13a71dde6cf3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:25.059065 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9870437d-7bc1-43d1-bc6e-13a71dde6cf3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:25.059515 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9870437d-7bc1-43d1-bc6e-13a71dde6cf3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:25.060301 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9870437d-7bc1-43d1-bc6e-13a71dde6cf3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:25.060882 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9870437d-7bc1-43d1-bc6e-13a71dde6cf3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:25.208027 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9870437d-7bc1-43d1-bc6e-13a71dde6cf3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:25.210071 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9870437d-7bc1-43d1-bc6e-13a71dde6cf3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:25.211132 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9870437d-7bc1-43d1-bc6e-13a71dde6cf3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:25.212354 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9870437d-7bc1-43d1-bc6e-13a71dde6cf3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.165405 Jun 06 13:15:25.218090 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 460/898] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:25 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:26.230080 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f0bd7dc7-b834-42cf-9dc9-889b6c23c70e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:26.230684 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f0bd7dc7-b834-42cf-9dc9-889b6c23c70e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:26.237580 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f0bd7dc7-b834-42cf-9dc9-889b6c23c70e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:26.238023 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f0bd7dc7-b834-42cf-9dc9-889b6c23c70e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:26.238783 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f0bd7dc7-b834-42cf-9dc9-889b6c23c70e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:26.239214 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f0bd7dc7-b834-42cf-9dc9-889b6c23c70e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:26.369871 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f0bd7dc7-b834-42cf-9dc9-889b6c23c70e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:26.378322 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f0bd7dc7-b834-42cf-9dc9-889b6c23c70e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:26.379871 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f0bd7dc7-b834-42cf-9dc9-889b6c23c70e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:26.381020 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f0bd7dc7-b834-42cf-9dc9-889b6c23c70e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.154842 Jun 06 13:15:26.381585 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 439/899] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:26 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:27.398728 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e14f9e46-0991-4676-8a95-b282f9010d82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:27.399334 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e14f9e46-0991-4676-8a95-b282f9010d82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:27.406039 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e14f9e46-0991-4676-8a95-b282f9010d82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:27.406485 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e14f9e46-0991-4676-8a95-b282f9010d82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:27.407238 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e14f9e46-0991-4676-8a95-b282f9010d82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:27.407717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e14f9e46-0991-4676-8a95-b282f9010d82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:27.538566 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e14f9e46-0991-4676-8a95-b282f9010d82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:27.546939 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e14f9e46-0991-4676-8a95-b282f9010d82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:27.548518 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e14f9e46-0991-4676-8a95-b282f9010d82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:27.549874 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e14f9e46-0991-4676-8a95-b282f9010d82 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.154904 Jun 06 13:15:27.550648 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 461/900] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:27 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:28.567098 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-88e5a049-e820-45bc-a297-b67020783725 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:28.567770 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-88e5a049-e820-45bc-a297-b67020783725 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:28.574381 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-88e5a049-e820-45bc-a297-b67020783725 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:28.574830 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-88e5a049-e820-45bc-a297-b67020783725 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:28.575622 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-88e5a049-e820-45bc-a297-b67020783725 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:28.576057 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-88e5a049-e820-45bc-a297-b67020783725 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:28.702431 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-88e5a049-e820-45bc-a297-b67020783725 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:28.711467 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-88e5a049-e820-45bc-a297-b67020783725 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:28.713013 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-88e5a049-e820-45bc-a297-b67020783725 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:28.714172 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-88e5a049-e820-45bc-a297-b67020783725 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.151010 Jun 06 13:15:28.714731 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 440/901] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:28 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:29.734140 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c102b4c4-b1df-4e4e-9bd6-f51cf3a286ae tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:29.734731 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c102b4c4-b1df-4e4e-9bd6-f51cf3a286ae tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:29.742076 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c102b4c4-b1df-4e4e-9bd6-f51cf3a286ae tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:29.742527 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c102b4c4-b1df-4e4e-9bd6-f51cf3a286ae tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:29.743291 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c102b4c4-b1df-4e4e-9bd6-f51cf3a286ae tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:29.743759 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c102b4c4-b1df-4e4e-9bd6-f51cf3a286ae tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:29.881914 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c102b4c4-b1df-4e4e-9bd6-f51cf3a286ae tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:29.889779 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c102b4c4-b1df-4e4e-9bd6-f51cf3a286ae tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:29.891261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c102b4c4-b1df-4e4e-9bd6-f51cf3a286ae tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:29.892428 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c102b4c4-b1df-4e4e-9bd6-f51cf3a286ae tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.162233 Jun 06 13:15:29.893030 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 462/902] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:29 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:30.910891 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3a033e3f-b55a-48aa-b122-9b77cb90aae4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:30.911551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3a033e3f-b55a-48aa-b122-9b77cb90aae4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:30.918147 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3a033e3f-b55a-48aa-b122-9b77cb90aae4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:30.918592 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3a033e3f-b55a-48aa-b122-9b77cb90aae4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:30.919354 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3a033e3f-b55a-48aa-b122-9b77cb90aae4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:30.919815 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3a033e3f-b55a-48aa-b122-9b77cb90aae4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:31.049012 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3a033e3f-b55a-48aa-b122-9b77cb90aae4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:31.056894 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3a033e3f-b55a-48aa-b122-9b77cb90aae4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:31.058393 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3a033e3f-b55a-48aa-b122-9b77cb90aae4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:31.059551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3a033e3f-b55a-48aa-b122-9b77cb90aae4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.153248 Jun 06 13:15:31.060119 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 441/903] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:30 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:32.077606 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-44a174d1-d071-404c-a7e5-cb2460d6ea4d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:32.078203 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-44a174d1-d071-404c-a7e5-cb2460d6ea4d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:32.084725 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-44a174d1-d071-404c-a7e5-cb2460d6ea4d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:32.085159 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-44a174d1-d071-404c-a7e5-cb2460d6ea4d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:32.085905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-44a174d1-d071-404c-a7e5-cb2460d6ea4d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:32.086330 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-44a174d1-d071-404c-a7e5-cb2460d6ea4d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:32.228645 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-44a174d1-d071-404c-a7e5-cb2460d6ea4d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:32.236906 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-44a174d1-d071-404c-a7e5-cb2460d6ea4d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:32.239143 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-44a174d1-d071-404c-a7e5-cb2460d6ea4d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:32.240366 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-44a174d1-d071-404c-a7e5-cb2460d6ea4d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.166607 Jun 06 13:15:32.241024 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 463/904] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:32 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:33.259063 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ef0d6a80-9e2c-464e-ae4f-71d42c0d0096 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:33.259668 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ef0d6a80-9e2c-464e-ae4f-71d42c0d0096 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:33.266230 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ef0d6a80-9e2c-464e-ae4f-71d42c0d0096 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:33.266679 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ef0d6a80-9e2c-464e-ae4f-71d42c0d0096 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:33.267442 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ef0d6a80-9e2c-464e-ae4f-71d42c0d0096 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:33.267901 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ef0d6a80-9e2c-464e-ae4f-71d42c0d0096 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:33.401683 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ef0d6a80-9e2c-464e-ae4f-71d42c0d0096 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:33.410792 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ef0d6a80-9e2c-464e-ae4f-71d42c0d0096 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:33.412449 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ef0d6a80-9e2c-464e-ae4f-71d42c0d0096 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:33.413606 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ef0d6a80-9e2c-464e-ae4f-71d42c0d0096 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.158541 Jun 06 13:15:33.414158 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 442/905] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:33 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:34.433206 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-79d2e6cd-0606-4f39-a6d5-9d8e432674cf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:34.433823 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-79d2e6cd-0606-4f39-a6d5-9d8e432674cf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:34.440593 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79d2e6cd-0606-4f39-a6d5-9d8e432674cf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:34.441081 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79d2e6cd-0606-4f39-a6d5-9d8e432674cf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:34.441857 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79d2e6cd-0606-4f39-a6d5-9d8e432674cf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:34.442296 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-79d2e6cd-0606-4f39-a6d5-9d8e432674cf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:34.578332 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-79d2e6cd-0606-4f39-a6d5-9d8e432674cf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:34.586467 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-79d2e6cd-0606-4f39-a6d5-9d8e432674cf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:34.588050 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-79d2e6cd-0606-4f39-a6d5-9d8e432674cf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:34.589199 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-79d2e6cd-0606-4f39-a6d5-9d8e432674cf tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.160027 Jun 06 13:15:34.589759 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 464/906] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:34 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:35.607715 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c3f26c6d-b7fb-407c-8962-d1403a043222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:35.608311 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c3f26c6d-b7fb-407c-8962-d1403a043222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:35.615291 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c3f26c6d-b7fb-407c-8962-d1403a043222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:35.615763 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c3f26c6d-b7fb-407c-8962-d1403a043222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:35.616512 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c3f26c6d-b7fb-407c-8962-d1403a043222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:35.616935 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c3f26c6d-b7fb-407c-8962-d1403a043222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:35.747814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c3f26c6d-b7fb-407c-8962-d1403a043222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:35.756324 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c3f26c6d-b7fb-407c-8962-d1403a043222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:35.757815 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c3f26c6d-b7fb-407c-8962-d1403a043222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:35.758953 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c3f26c6d-b7fb-407c-8962-d1403a043222 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.155123 Jun 06 13:15:35.759496 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 443/907] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:35 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:36.777150 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a4df3e70-a182-49be-8fc9-5418dc0a2dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:36.777691 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a4df3e70-a182-49be-8fc9-5418dc0a2dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:36.783880 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4df3e70-a182-49be-8fc9-5418dc0a2dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:36.784487 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4df3e70-a182-49be-8fc9-5418dc0a2dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:36.785248 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4df3e70-a182-49be-8fc9-5418dc0a2dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:36.785679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4df3e70-a182-49be-8fc9-5418dc0a2dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:36.912379 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a4df3e70-a182-49be-8fc9-5418dc0a2dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:36.920934 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a4df3e70-a182-49be-8fc9-5418dc0a2dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:36.922429 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a4df3e70-a182-49be-8fc9-5418dc0a2dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:36.926340 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a4df3e70-a182-49be-8fc9-5418dc0a2dc1 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.150644 Jun 06 13:15:36.926340 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 465/908] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:36 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:37.942245 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-30c37f98-2636-4a2b-8ea9-38ace830cecd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:37.942839 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-30c37f98-2636-4a2b-8ea9-38ace830cecd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:37.949328 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-30c37f98-2636-4a2b-8ea9-38ace830cecd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:37.949765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-30c37f98-2636-4a2b-8ea9-38ace830cecd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:37.950512 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-30c37f98-2636-4a2b-8ea9-38ace830cecd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:37.950937 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-30c37f98-2636-4a2b-8ea9-38ace830cecd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:38.081070 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-30c37f98-2636-4a2b-8ea9-38ace830cecd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:38.089145 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-30c37f98-2636-4a2b-8ea9-38ace830cecd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:38.090639 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-30c37f98-2636-4a2b-8ea9-38ace830cecd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:38.091845 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-30c37f98-2636-4a2b-8ea9-38ace830cecd tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.154044 Jun 06 13:15:38.092403 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 444/909] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:37 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:39.110616 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-394dae85-b737-423e-86be-c9b587c3bc0f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:39.111145 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-394dae85-b737-423e-86be-c9b587c3bc0f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:39.118129 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-394dae85-b737-423e-86be-c9b587c3bc0f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:39.118579 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-394dae85-b737-423e-86be-c9b587c3bc0f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:39.119342 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-394dae85-b737-423e-86be-c9b587c3bc0f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:39.119800 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-394dae85-b737-423e-86be-c9b587c3bc0f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:39.255686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-394dae85-b737-423e-86be-c9b587c3bc0f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:39.263460 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-394dae85-b737-423e-86be-c9b587c3bc0f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:39.264973 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-394dae85-b737-423e-86be-c9b587c3bc0f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:39.266113 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-394dae85-b737-423e-86be-c9b587c3bc0f tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.159723 Jun 06 13:15:39.266664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 466/910] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:39 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:40.284568 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3d27e010-3209-4352-aac4-90b6c80c5eee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:40.285270 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3d27e010-3209-4352-aac4-90b6c80c5eee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:40.291623 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d27e010-3209-4352-aac4-90b6c80c5eee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:40.292062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d27e010-3209-4352-aac4-90b6c80c5eee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:40.292808 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d27e010-3209-4352-aac4-90b6c80c5eee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:40.293238 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d27e010-3209-4352-aac4-90b6c80c5eee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:40.418329 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3d27e010-3209-4352-aac4-90b6c80c5eee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:40.426743 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3d27e010-3209-4352-aac4-90b6c80c5eee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:40.428263 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3d27e010-3209-4352-aac4-90b6c80c5eee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:40.429403 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3d27e010-3209-4352-aac4-90b6c80c5eee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.149424 Jun 06 13:15:40.429956 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 445/911] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:40 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:41.447345 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-994364c3-244a-419e-98bd-d701c257831d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:41.447979 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-994364c3-244a-419e-98bd-d701c257831d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:41.454556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-994364c3-244a-419e-98bd-d701c257831d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:41.455005 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-994364c3-244a-419e-98bd-d701c257831d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:41.456308 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-994364c3-244a-419e-98bd-d701c257831d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:41.456893 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-994364c3-244a-419e-98bd-d701c257831d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:41.586296 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-994364c3-244a-419e-98bd-d701c257831d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:41.594099 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-994364c3-244a-419e-98bd-d701c257831d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:41.595607 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-994364c3-244a-419e-98bd-d701c257831d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:41.597332 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-994364c3-244a-419e-98bd-d701c257831d tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.153405 Jun 06 13:15:41.598035 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 467/912] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:41 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:42.616874 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1aab1917-d082-4ecf-be0c-6d7a6b322c9b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:42.617522 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1aab1917-d082-4ecf-be0c-6d7a6b322c9b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:42.624061 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1aab1917-d082-4ecf-be0c-6d7a6b322c9b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:42.624508 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1aab1917-d082-4ecf-be0c-6d7a6b322c9b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:42.625268 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1aab1917-d082-4ecf-be0c-6d7a6b322c9b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:42.625705 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1aab1917-d082-4ecf-be0c-6d7a6b322c9b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:42.629984 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=86,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:42.757094 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1aab1917-d082-4ecf-be0c-6d7a6b322c9b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:42.765488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1aab1917-d082-4ecf-be0c-6d7a6b322c9b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:42.766987 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1aab1917-d082-4ecf-be0c-6d7a6b322c9b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:42.768174 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1aab1917-d082-4ecf-be0c-6d7a6b322c9b tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.156039 Jun 06 13:15:42.768876 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 446/913] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:42 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:43.787332 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d0732882-a9e5-48ee-bc49-9d35f0794152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:43.788039 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d0732882-a9e5-48ee-bc49-9d35f0794152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:43.794533 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0732882-a9e5-48ee-bc49-9d35f0794152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:43.795166 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0732882-a9e5-48ee-bc49-9d35f0794152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:43.796233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0732882-a9e5-48ee-bc49-9d35f0794152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:43.796669 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d0732882-a9e5-48ee-bc49-9d35f0794152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:43.929498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0732882-a9e5-48ee-bc49-9d35f0794152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:43.937480 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0732882-a9e5-48ee-bc49-9d35f0794152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:43.938985 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d0732882-a9e5-48ee-bc49-9d35f0794152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:43.940313 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d0732882-a9e5-48ee-bc49-9d35f0794152 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.157969 Jun 06 13:15:43.941101 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 468/914] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:43 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:44.958124 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bada9128-1720-4fcc-80e6-1c0124dc49b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:44.958777 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-bada9128-1720-4fcc-80e6-1c0124dc49b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:44.965537 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bada9128-1720-4fcc-80e6-1c0124dc49b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:44.965975 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bada9128-1720-4fcc-80e6-1c0124dc49b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:44.966733 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bada9128-1720-4fcc-80e6-1c0124dc49b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:44.967166 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bada9128-1720-4fcc-80e6-1c0124dc49b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:45.096318 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-bada9128-1720-4fcc-80e6-1c0124dc49b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:45.104829 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-bada9128-1720-4fcc-80e6-1c0124dc49b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:45.106334 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-bada9128-1720-4fcc-80e6-1c0124dc49b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:45.107485 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-bada9128-1720-4fcc-80e6-1c0124dc49b3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.153424 Jun 06 13:15:45.108077 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 447/915] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:44 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:46.126116 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-19ce2c02-ebd3-4384-8181-6169e8e6e863 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:46.133534 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-19ce2c02-ebd3-4384-8181-6169e8e6e863 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:46.133758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-19ce2c02-ebd3-4384-8181-6169e8e6e863 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:46.134213 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-19ce2c02-ebd3-4384-8181-6169e8e6e863 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:46.134974 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-19ce2c02-ebd3-4384-8181-6169e8e6e863 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:46.135410 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-19ce2c02-ebd3-4384-8181-6169e8e6e863 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:46.265863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-19ce2c02-ebd3-4384-8181-6169e8e6e863 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:46.274635 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-19ce2c02-ebd3-4384-8181-6169e8e6e863 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:46.276184 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-19ce2c02-ebd3-4384-8181-6169e8e6e863 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:46.277350 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-19ce2c02-ebd3-4384-8181-6169e8e6e863 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.155193 Jun 06 13:15:46.277906 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 469/916] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:46 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:47.296624 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-92be73ef-de77-4477-be35-8fe33f90ab5e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:47.297212 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-92be73ef-de77-4477-be35-8fe33f90ab5e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:47.303864 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-92be73ef-de77-4477-be35-8fe33f90ab5e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:47.304314 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-92be73ef-de77-4477-be35-8fe33f90ab5e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:47.305083 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-92be73ef-de77-4477-be35-8fe33f90ab5e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:47.305522 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-92be73ef-de77-4477-be35-8fe33f90ab5e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:47.437056 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-92be73ef-de77-4477-be35-8fe33f90ab5e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:47.445722 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-92be73ef-de77-4477-be35-8fe33f90ab5e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:47.447232 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-92be73ef-de77-4477-be35-8fe33f90ab5e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:47.448426 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-92be73ef-de77-4477-be35-8fe33f90ab5e tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.155990 Jun 06 13:15:47.448995 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 448/917] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:47 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:48.467397 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7ba9a898-559a-4824-8487-48d1da7918da tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:48.468037 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7ba9a898-559a-4824-8487-48d1da7918da tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:48.470473 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=32 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:48.475927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ba9a898-559a-4824-8487-48d1da7918da tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:48.476375 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ba9a898-559a-4824-8487-48d1da7918da tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:48.477135 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ba9a898-559a-4824-8487-48d1da7918da tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:48.477569 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ba9a898-559a-4824-8487-48d1da7918da tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:48.481433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=95 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:48.604213 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7ba9a898-559a-4824-8487-48d1da7918da tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:48.612225 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7ba9a898-559a-4824-8487-48d1da7918da tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:48.613855 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7ba9a898-559a-4824-8487-48d1da7918da tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:48.615016 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7ba9a898-559a-4824-8487-48d1da7918da tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1730 microversion: 2.20 time: 0.151545 Jun 06 13:15:48.615601 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 470/918] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:48 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1730 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:49.633737 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-307b134a-1f07-4428-ada2-447d94608551 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:49.634363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-307b134a-1f07-4428-ada2-447d94608551 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:49.640952 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-307b134a-1f07-4428-ada2-447d94608551 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:49.641405 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-307b134a-1f07-4428-ada2-447d94608551 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:49.642169 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-307b134a-1f07-4428-ada2-447d94608551 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:49.642729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-307b134a-1f07-4428-ada2-447d94608551 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:49.777576 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-307b134a-1f07-4428-ada2-447d94608551 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:49.785487 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-307b134a-1f07-4428-ada2-447d94608551 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:49.786968 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-307b134a-1f07-4428-ada2-447d94608551 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:49.788137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-307b134a-1f07-4428-ada2-447d94608551 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1717 microversion: 2.20 time: 0.158568 Jun 06 13:15:49.788686 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 449/919] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:15:49 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1717 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:15:50.458639 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1de36cd7-1e88-4f2f-a4ef-46a27ea2b850 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:50.459135 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1de36cd7-1e88-4f2f-a4ef-46a27ea2b850 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:50.465814 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1de36cd7-1e88-4f2f-a4ef-46a27ea2b850 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:50.466263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1de36cd7-1e88-4f2f-a4ef-46a27ea2b850 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:50.467061 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1de36cd7-1e88-4f2f-a4ef-46a27ea2b850 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:50.467521 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1de36cd7-1e88-4f2f-a4ef-46a27ea2b850 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:50.555114 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-1de36cd7-1e88-4f2f-a4ef-46a27ea2b850 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lazy-loading 'services' on Instance uuid 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:15:50.723902 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1de36cd7-1e88-4f2f-a4ef-46a27ea2b850 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments/110239af-af5b-4d5f-80e5-0c523d5cad07" status: 202 len: 0 microversion: 2.1 time: 0.269803 Jun 06 13:15:50.724688 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 471/920] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 13:15:50 2022] DELETE /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments/110239af-af5b-4d5f-80e5-0c523d5cad07 => generated 0 bytes in 271 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:15:50.732838 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3c991c00-df84-40e7-91d3-623088fd7026 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:50.733754 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3c991c00-df84-40e7-91d3-623088fd7026 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:50.741016 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3c991c00-df84-40e7-91d3-623088fd7026 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:50.741452 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3c991c00-df84-40e7-91d3-623088fd7026 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:50.742198 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3c991c00-df84-40e7-91d3-623088fd7026 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:50.742627 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3c991c00-df84-40e7-91d3-623088fd7026 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:50.771915 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3c991c00-df84-40e7-91d3-623088fd7026 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042845 Jun 06 13:15:50.772391 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 450/921] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:15:50 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:15:51.784686 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7ad71f9e-1927-4501-a27d-77a58560f11e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:51.791714 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7ad71f9e-1927-4501-a27d-77a58560f11e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:51.792578 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ad71f9e-1927-4501-a27d-77a58560f11e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:51.793032 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ad71f9e-1927-4501-a27d-77a58560f11e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:51.793804 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ad71f9e-1927-4501-a27d-77a58560f11e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:51.794245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7ad71f9e-1927-4501-a27d-77a58560f11e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:51.825248 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7ad71f9e-1927-4501-a27d-77a58560f11e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046110 Jun 06 13:15:51.825837 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 472/922] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:15:51 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:15:52.837232 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c75d7967-0a71-4972-86ea-f0a26a08b7cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:52.838178 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c75d7967-0a71-4972-86ea-f0a26a08b7cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:52.848819 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c75d7967-0a71-4972-86ea-f0a26a08b7cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:52.849271 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c75d7967-0a71-4972-86ea-f0a26a08b7cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:52.850070 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c75d7967-0a71-4972-86ea-f0a26a08b7cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:52.850500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c75d7967-0a71-4972-86ea-f0a26a08b7cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:52.881330 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c75d7967-0a71-4972-86ea-f0a26a08b7cd tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047879 Jun 06 13:15:52.881938 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 451/923] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:15:52 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:15:53.892928 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0ead69f5-cee6-46b3-b718-1b705bd8baeb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:53.894815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0ead69f5-cee6-46b3-b718-1b705bd8baeb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:53.901098 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ead69f5-cee6-46b3-b718-1b705bd8baeb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:53.901546 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ead69f5-cee6-46b3-b718-1b705bd8baeb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:53.902313 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ead69f5-cee6-46b3-b718-1b705bd8baeb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:53.902751 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ead69f5-cee6-46b3-b718-1b705bd8baeb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:53.934551 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0ead69f5-cee6-46b3-b718-1b705bd8baeb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045649 Jun 06 13:15:53.935121 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 473/924] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:15:53 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:15:54.947029 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a5da1414-5acb-4d86-8786-784b84fd3733 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:54.948009 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a5da1414-5acb-4d86-8786-784b84fd3733 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:54.950247 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=28 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:15:54.955369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5da1414-5acb-4d86-8786-784b84fd3733 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:54.955850 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5da1414-5acb-4d86-8786-784b84fd3733 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:54.957063 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5da1414-5acb-4d86-8786-784b84fd3733 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:54.957228 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a5da1414-5acb-4d86-8786-784b84fd3733 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:54.988990 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a5da1414-5acb-4d86-8786-784b84fd3733 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045844 Jun 06 13:15:54.989468 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 452/925] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:15:54 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:15:56.000600 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-87dac992-84d2-4c24-8cdd-492c19545f3f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:56.001555 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-87dac992-84d2-4c24-8cdd-492c19545f3f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:56.008591 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-87dac992-84d2-4c24-8cdd-492c19545f3f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:56.009039 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-87dac992-84d2-4c24-8cdd-492c19545f3f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:56.009838 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-87dac992-84d2-4c24-8cdd-492c19545f3f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:56.010280 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-87dac992-84d2-4c24-8cdd-492c19545f3f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:56.039805 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-87dac992-84d2-4c24-8cdd-492c19545f3f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043049 Jun 06 13:15:56.040374 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 474/926] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:15:55 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:15:57.052553 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-af716021-cb65-460e-9d7e-e7a24869c8e3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:57.053890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-af716021-cb65-460e-9d7e-e7a24869c8e3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:57.060706 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-af716021-cb65-460e-9d7e-e7a24869c8e3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:57.061147 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-af716021-cb65-460e-9d7e-e7a24869c8e3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:57.061898 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-af716021-cb65-460e-9d7e-e7a24869c8e3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:57.062325 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-af716021-cb65-460e-9d7e-e7a24869c8e3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:57.090627 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-af716021-cb65-460e-9d7e-e7a24869c8e3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042911 Jun 06 13:15:57.091173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 453/927] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:15:57 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:15:57.825310 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-731245749", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452"}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:15:57.875895 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] validate_networks() for None {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:15:58.103295 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a13e93ab-710a-42e6-a6bf-30627121ff40 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:58.104893 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a13e93ab-710a-42e6-a6bf-30627121ff40 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:58.112147 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a13e93ab-710a-42e6-a6bf-30627121ff40 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:58.113007 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a13e93ab-710a-42e6-a6bf-30627121ff40 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:58.113955 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a13e93ab-710a-42e6-a6bf-30627121ff40 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:58.115069 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a13e93ab-710a-42e6-a6bf-30627121ff40 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:58.146763 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a13e93ab-710a-42e6-a6bf-30627121ff40 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047339 Jun 06 13:15:58.147575 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 454/928] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:15:58 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:15:58.383986 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:15:58.384412 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:15:58.384885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:15:58.385292 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:15:58.385711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:15:58.394576 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:58.395233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:58.396502 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:58.396941 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:58.413858 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Getting quotas for project 4d69bf03f62e4bb28481e5f6b4061464. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:15:58.417824 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Getting quotas for user 862defb578e7407f9d6220846a5d369d and project 4d69bf03f62e4bb28481e5f6b4061464. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:15:58.429869 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:15:58.432122 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:15:58.543875 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ce85e8c4-8f07-4fa9-bbff-d748d0cc0bde tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.722294 Jun 06 13:15:58.544517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 475/929] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:15:57 2022] POST /compute/v2.1/servers => generated 380 bytes in 724 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 13:15:58.555330 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-db44524c-549f-4593-9f58-59e8f8a8d49e tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:58.556058 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-db44524c-549f-4593-9f58-59e8f8a8d49e tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:58.608499 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-db44524c-549f-4593-9f58-59e8f8a8d49e tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:58.615648 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-db44524c-549f-4593-9f58-59e8f8a8d49e tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1214 microversion: 2.1 time: 0.064794 Jun 06 13:15:58.616207 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 455/930] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:15:58 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1214 bytes in 66 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:15:59.159325 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fd91ea66-6c5f-493c-990a-8bd1d8588928 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:59.160244 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fd91ea66-6c5f-493c-990a-8bd1d8588928 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:59.167517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd91ea66-6c5f-493c-990a-8bd1d8588928 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:59.168028 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd91ea66-6c5f-493c-990a-8bd1d8588928 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:59.168788 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd91ea66-6c5f-493c-990a-8bd1d8588928 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:59.169220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fd91ea66-6c5f-493c-990a-8bd1d8588928 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:59.198415 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fd91ea66-6c5f-493c-990a-8bd1d8588928 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.043780 Jun 06 13:15:59.198978 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 476/931] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:15:59 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:15:59.633080 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-74877dc5-4270-4e52-9407-58e59d32c478 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:59.633691 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-74877dc5-4270-4e52-9407-58e59d32c478 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:59.640238 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-74877dc5-4270-4e52-9407-58e59d32c478 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:59.640681 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-74877dc5-4270-4e52-9407-58e59d32c478 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:59.641442 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-74877dc5-4270-4e52-9407-58e59d32c478 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:59.641875 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-74877dc5-4270-4e52-9407-58e59d32c478 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:59.667806 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0602f536-d8af-4845-9945-1671b004762a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:59.668727 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0602f536-d8af-4845-9945-1671b004762a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:59.675088 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0602f536-d8af-4845-9945-1671b004762a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:59.675550 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0602f536-d8af-4845-9945-1671b004762a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:59.676341 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0602f536-d8af-4845-9945-1671b004762a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:59.676966 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0602f536-d8af-4845-9945-1671b004762a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:59.704159 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-74877dc5-4270-4e52-9407-58e59d32c478 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:15:59.706427 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0602f536-d8af-4845-9945-1671b004762a tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.042570 Jun 06 13:15:59.707005 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 477/932] 10.222.0.13 () {60 vars in 1342 bytes} [Mon Jun 6 13:15:59 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e/os-volume_attachments => generated 25 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:15:59.712407 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-74877dc5-4270-4e52-9407-58e59d32c478 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1218 microversion: 2.1 time: 0.083678 Jun 06 13:15:59.713481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 456/933] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:15:59 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1218 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:15:59.764905 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-49eceaa0-ea89-4b61-a754-b633c0595245 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:15:59.765334 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-49eceaa0-ea89-4b61-a754-b633c0595245 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:15:59.772002 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49eceaa0-ea89-4b61-a754-b633c0595245 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:59.772449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49eceaa0-ea89-4b61-a754-b633c0595245 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:59.773212 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49eceaa0-ea89-4b61-a754-b633c0595245 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:15:59.773648 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-49eceaa0-ea89-4b61-a754-b633c0595245 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:15:59.797881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-49eceaa0-ea89-4b61-a754-b633c0595245 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:16:00.068646 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-49eceaa0-ea89-4b61-a754-b633c0595245 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "DELETE /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 204 len: 0 microversion: 2.20 time: 0.306461 Jun 06 13:16:00.069159 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 478/934] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jun 6 13:15:59 2022] DELETE /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 0 bytes in 309 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Jun 06 13:16:00.077190 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c0bec291-e01a-4735-b9f1-8f1ab146a67c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:00.077802 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c0bec291-e01a-4735-b9f1-8f1ab146a67c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:00.084911 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c0bec291-e01a-4735-b9f1-8f1ab146a67c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:00.085363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c0bec291-e01a-4735-b9f1-8f1ab146a67c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:00.086127 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c0bec291-e01a-4735-b9f1-8f1ab146a67c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:00.086566 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c0bec291-e01a-4735-b9f1-8f1ab146a67c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:00.214945 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5f17c4e9-60de-4121-a084-a49ed02ffdf5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:00.215431 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c0bec291-e01a-4735-b9f1-8f1ab146a67c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:00.216045 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5f17c4e9-60de-4121-a084-a49ed02ffdf5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:00.222691 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5f17c4e9-60de-4121-a084-a49ed02ffdf5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:00.223136 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5f17c4e9-60de-4121-a084-a49ed02ffdf5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:00.223479 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c0bec291-e01a-4735-b9f1-8f1ab146a67c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:00.224210 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5f17c4e9-60de-4121-a084-a49ed02ffdf5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:00.224681 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5f17c4e9-60de-4121-a084-a49ed02ffdf5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:00.225706 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c0bec291-e01a-4735-b9f1-8f1ab146a67c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:00.226877 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c0bec291-e01a-4735-b9f1-8f1ab146a67c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.153534 Jun 06 13:16:00.227432 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 457/935] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:16:00 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:16:00.257666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5f17c4e9-60de-4121-a084-a49ed02ffdf5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.047026 Jun 06 13:16:00.258224 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 479/936] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:16:00 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:16:00.730261 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-37b9a7a2-7737-4641-951d-51122f82c5ce tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:00.730865 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-37b9a7a2-7737-4641-951d-51122f82c5ce tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:00.737293 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-37b9a7a2-7737-4641-951d-51122f82c5ce tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:00.737734 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-37b9a7a2-7737-4641-951d-51122f82c5ce tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:00.738481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-37b9a7a2-7737-4641-951d-51122f82c5ce tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:00.738908 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-37b9a7a2-7737-4641-951d-51122f82c5ce tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:00.801090 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-37b9a7a2-7737-4641-951d-51122f82c5ce tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:00.807039 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-37b9a7a2-7737-4641-951d-51122f82c5ce tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1218 microversion: 2.1 time: 0.080648 Jun 06 13:16:00.807607 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 458/937] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:00 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1218 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:01.245499 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-88cd8020-2e14-4073-a496-683488ed3f16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:01.246134 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-88cd8020-2e14-4073-a496-683488ed3f16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:01.252751 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-88cd8020-2e14-4073-a496-683488ed3f16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:01.253198 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-88cd8020-2e14-4073-a496-683488ed3f16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:01.253984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-88cd8020-2e14-4073-a496-683488ed3f16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:01.254418 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-88cd8020-2e14-4073-a496-683488ed3f16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:01.269171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-90fb282f-c109-4ed2-8e33-eecc1b0ce077 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:01.270148 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-90fb282f-c109-4ed2-8e33-eecc1b0ce077 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:01.277046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-90fb282f-c109-4ed2-8e33-eecc1b0ce077 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:01.277488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-90fb282f-c109-4ed2-8e33-eecc1b0ce077 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:01.278246 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-90fb282f-c109-4ed2-8e33-eecc1b0ce077 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:01.278674 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-90fb282f-c109-4ed2-8e33-eecc1b0ce077 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:01.307874 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-90fb282f-c109-4ed2-8e33-eecc1b0ce077 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042540 Jun 06 13:16:01.308433 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 459/938] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:16:01 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:16:01.382511 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-88cd8020-2e14-4073-a496-683488ed3f16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:01.390655 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-88cd8020-2e14-4073-a496-683488ed3f16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:01.392179 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-88cd8020-2e14-4073-a496-683488ed3f16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:01.393328 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-88cd8020-2e14-4073-a496-683488ed3f16 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.151745 Jun 06 13:16:01.393880 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 480/939] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:16:01 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:16:01.824368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2012c8dd-59b7-4080-96f2-d6ff7fbb2492 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:01.824970 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2012c8dd-59b7-4080-96f2-d6ff7fbb2492 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:01.831542 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2012c8dd-59b7-4080-96f2-d6ff7fbb2492 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:01.831989 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2012c8dd-59b7-4080-96f2-d6ff7fbb2492 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:01.832732 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2012c8dd-59b7-4080-96f2-d6ff7fbb2492 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:01.833269 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2012c8dd-59b7-4080-96f2-d6ff7fbb2492 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:01.897684 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-2012c8dd-59b7-4080-96f2-d6ff7fbb2492 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:01.905570 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2012c8dd-59b7-4080-96f2-d6ff7fbb2492 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1218 microversion: 2.1 time: 0.085050 Jun 06 13:16:01.906141 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 460/940] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:01 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1218 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:02.320404 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c6d6237e-86a1-4b9d-b758-a08037aed5e5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:02.321317 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c6d6237e-86a1-4b9d-b758-a08037aed5e5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:02.327752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6d6237e-86a1-4b9d-b758-a08037aed5e5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:02.328195 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6d6237e-86a1-4b9d-b758-a08037aed5e5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:02.328949 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6d6237e-86a1-4b9d-b758-a08037aed5e5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:02.329373 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6d6237e-86a1-4b9d-b758-a08037aed5e5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:02.358215 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c6d6237e-86a1-4b9d-b758-a08037aed5e5 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042552 Jun 06 13:16:02.358768 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 481/941] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:16:02 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:02.412591 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1d1d0d6d-94ec-4f7c-af2e-25dc5ed942d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:02.413204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1d1d0d6d-94ec-4f7c-af2e-25dc5ed942d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:02.419214 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1d1d0d6d-94ec-4f7c-af2e-25dc5ed942d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:02.419707 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1d1d0d6d-94ec-4f7c-af2e-25dc5ed942d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:02.420462 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1d1d0d6d-94ec-4f7c-af2e-25dc5ed942d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:02.420893 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1d1d0d6d-94ec-4f7c-af2e-25dc5ed942d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:02.559715 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1d1d0d6d-94ec-4f7c-af2e-25dc5ed942d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:02.568154 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1d1d0d6d-94ec-4f7c-af2e-25dc5ed942d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:02.569652 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1d1d0d6d-94ec-4f7c-af2e-25dc5ed942d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:02.570853 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1d1d0d6d-94ec-4f7c-af2e-25dc5ed942d0 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.162304 Jun 06 13:16:02.571358 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 461/942] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:16:02 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:16:02.922491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-001cfcf7-32c2-4f78-9cd7-d78de10a92ec tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:02.923124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-001cfcf7-32c2-4f78-9cd7-d78de10a92ec tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:02.930024 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-001cfcf7-32c2-4f78-9cd7-d78de10a92ec tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:02.930472 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-001cfcf7-32c2-4f78-9cd7-d78de10a92ec tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:02.931237 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-001cfcf7-32c2-4f78-9cd7-d78de10a92ec tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:02.931704 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-001cfcf7-32c2-4f78-9cd7-d78de10a92ec tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:02.993301 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-001cfcf7-32c2-4f78-9cd7-d78de10a92ec tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:03.000945 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-001cfcf7-32c2-4f78-9cd7-d78de10a92ec tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1218 microversion: 2.1 time: 0.082548 Jun 06 13:16:03.001545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 482/943] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:02 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:03.371172 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b4fcec95-5bba-4e63-a800-c2cc58410064 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:03.372050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b4fcec95-5bba-4e63-a800-c2cc58410064 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:03.378757 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b4fcec95-5bba-4e63-a800-c2cc58410064 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:03.379205 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b4fcec95-5bba-4e63-a800-c2cc58410064 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:03.380054 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b4fcec95-5bba-4e63-a800-c2cc58410064 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:03.380488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b4fcec95-5bba-4e63-a800-c2cc58410064 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:03.412989 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b4fcec95-5bba-4e63-a800-c2cc58410064 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046904 Jun 06 13:16:03.413559 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 462/944] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:16:03 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:03.589548 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-11c258d0-d97d-48fa-a17c-7bf95b4dafc8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:03.590191 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-11c258d0-d97d-48fa-a17c-7bf95b4dafc8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:03.596684 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11c258d0-d97d-48fa-a17c-7bf95b4dafc8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:03.597139 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11c258d0-d97d-48fa-a17c-7bf95b4dafc8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:03.597904 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11c258d0-d97d-48fa-a17c-7bf95b4dafc8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:03.598345 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-11c258d0-d97d-48fa-a17c-7bf95b4dafc8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:03.729094 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-11c258d0-d97d-48fa-a17c-7bf95b4dafc8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:03.736985 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-11c258d0-d97d-48fa-a17c-7bf95b4dafc8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:03.738496 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-11c258d0-d97d-48fa-a17c-7bf95b4dafc8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:03.740637 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-11c258d0-d97d-48fa-a17c-7bf95b4dafc8 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.154876 Jun 06 13:16:03.741199 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 483/945] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:16:03 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:16:04.018304 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-8b203cf1-1f4d-48d2-b60c-4b517a98fc2f tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:04.018836 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8b203cf1-1f4d-48d2-b60c-4b517a98fc2f tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:04.025770 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8b203cf1-1f4d-48d2-b60c-4b517a98fc2f tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:04.026216 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8b203cf1-1f4d-48d2-b60c-4b517a98fc2f tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:04.026979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8b203cf1-1f4d-48d2-b60c-4b517a98fc2f tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:04.027415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8b203cf1-1f4d-48d2-b60c-4b517a98fc2f tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:04.088872 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-8b203cf1-1f4d-48d2-b60c-4b517a98fc2f tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:04.091077 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=100 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:04.096918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-8b203cf1-1f4d-48d2-b60c-4b517a98fc2f tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1218 microversion: 2.1 time: 0.082571 Jun 06 13:16:04.097476 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 463/946] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:04 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1218 bytes in 84 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:04.424841 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-da1dc553-dea3-4eb5-bb0f-7e9ae22db21f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:04.425815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-da1dc553-dea3-4eb5-bb0f-7e9ae22db21f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:04.432636 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-da1dc553-dea3-4eb5-bb0f-7e9ae22db21f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:04.433076 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-da1dc553-dea3-4eb5-bb0f-7e9ae22db21f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:04.433827 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-da1dc553-dea3-4eb5-bb0f-7e9ae22db21f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:04.434253 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-da1dc553-dea3-4eb5-bb0f-7e9ae22db21f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:04.462123 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-da1dc553-dea3-4eb5-bb0f-7e9ae22db21f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.041530 Jun 06 13:16:04.462666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 484/947] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:16:04 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:04.759942 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-317aca29-3bef-4be1-bdb5-e690b64fbe30 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:04.760522 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-317aca29-3bef-4be1-bdb5-e690b64fbe30 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:04.766999 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-317aca29-3bef-4be1-bdb5-e690b64fbe30 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:04.767445 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-317aca29-3bef-4be1-bdb5-e690b64fbe30 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:04.768235 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-317aca29-3bef-4be1-bdb5-e690b64fbe30 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:04.768672 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-317aca29-3bef-4be1-bdb5-e690b64fbe30 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:04.898196 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-317aca29-3bef-4be1-bdb5-e690b64fbe30 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:04.906435 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-317aca29-3bef-4be1-bdb5-e690b64fbe30 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:04.908041 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-317aca29-3bef-4be1-bdb5-e690b64fbe30 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:04.909205 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-317aca29-3bef-4be1-bdb5-e690b64fbe30 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.154221 Jun 06 13:16:04.909781 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 464/948] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:16:04 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:16:05.114208 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c5e4c186-59b4-4c7f-bc7a-fe0f02439325 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:05.115101 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c5e4c186-59b4-4c7f-bc7a-fe0f02439325 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:05.121024 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c5e4c186-59b4-4c7f-bc7a-fe0f02439325 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:05.121463 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c5e4c186-59b4-4c7f-bc7a-fe0f02439325 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:05.122218 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c5e4c186-59b4-4c7f-bc7a-fe0f02439325 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:05.122643 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c5e4c186-59b4-4c7f-bc7a-fe0f02439325 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:05.126819 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:05.188114 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c5e4c186-59b4-4c7f-bc7a-fe0f02439325 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:05.196423 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c5e4c186-59b4-4c7f-bc7a-fe0f02439325 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1218 microversion: 2.1 time: 0.086176 Jun 06 13:16:05.196985 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 485/949] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:05 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:05.474479 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9efe4265-7edd-4035-9125-55e10a845dce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:05.475435 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9efe4265-7edd-4035-9125-55e10a845dce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:05.481767 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9efe4265-7edd-4035-9125-55e10a845dce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:05.482211 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9efe4265-7edd-4035-9125-55e10a845dce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:05.483013 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9efe4265-7edd-4035-9125-55e10a845dce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:05.483434 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9efe4265-7edd-4035-9125-55e10a845dce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:05.511763 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9efe4265-7edd-4035-9125-55e10a845dce tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042097 Jun 06 13:16:05.512316 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 465/950] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:16:05 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:05.929482 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e2673882-f861-43bc-a1e4-23146e674434 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:05.930223 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e2673882-f861-43bc-a1e4-23146e674434 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:05.936418 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e2673882-f861-43bc-a1e4-23146e674434 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:05.936858 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e2673882-f861-43bc-a1e4-23146e674434 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:05.937603 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e2673882-f861-43bc-a1e4-23146e674434 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:05.938031 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e2673882-f861-43bc-a1e4-23146e674434 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:06.063732 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e2673882-f861-43bc-a1e4-23146e674434 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:06.072627 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e2673882-f861-43bc-a1e4-23146e674434 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:06.074168 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e2673882-f861-43bc-a1e4-23146e674434 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:06.075369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e2673882-f861-43bc-a1e4-23146e674434 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.150883 Jun 06 13:16:06.075956 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 486/951] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:16:05 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:16:06.213137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cd0a004f-50a2-441f-b0f7-89b42d6cf94a tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:06.213793 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-cd0a004f-50a2-441f-b0f7-89b42d6cf94a tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:06.219837 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cd0a004f-50a2-441f-b0f7-89b42d6cf94a tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:06.220287 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cd0a004f-50a2-441f-b0f7-89b42d6cf94a tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:06.221048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cd0a004f-50a2-441f-b0f7-89b42d6cf94a tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:06.221482 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cd0a004f-50a2-441f-b0f7-89b42d6cf94a tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:06.281075 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cd0a004f-50a2-441f-b0f7-89b42d6cf94a tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:06.289070 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cd0a004f-50a2-441f-b0f7-89b42d6cf94a tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1218 microversion: 2.1 time: 0.079762 Jun 06 13:16:06.289634 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 466/952] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:06 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1218 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:06.522509 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-668247e6-6063-4946-887e-08dcc56b9010 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:06.523454 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-668247e6-6063-4946-887e-08dcc56b9010 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:06.529581 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-668247e6-6063-4946-887e-08dcc56b9010 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:06.530027 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-668247e6-6063-4946-887e-08dcc56b9010 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:06.530783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-668247e6-6063-4946-887e-08dcc56b9010 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:06.531217 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-668247e6-6063-4946-887e-08dcc56b9010 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:06.560860 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-668247e6-6063-4946-887e-08dcc56b9010 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.042552 Jun 06 13:16:06.561402 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 487/953] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:16:06 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:07.094198 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f907d94c-8ad7-4860-bb31-083976aec3ee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:07.094729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f907d94c-8ad7-4860-bb31-083976aec3ee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:07.101980 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f907d94c-8ad7-4860-bb31-083976aec3ee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:07.102425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f907d94c-8ad7-4860-bb31-083976aec3ee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:07.103198 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f907d94c-8ad7-4860-bb31-083976aec3ee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:07.103654 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f907d94c-8ad7-4860-bb31-083976aec3ee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:07.237293 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f907d94c-8ad7-4860-bb31-083976aec3ee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:07.245496 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f907d94c-8ad7-4860-bb31-083976aec3ee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:07.245956 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6e43d16b-ba89-414d-b71c-4e41bc04a656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:07.246454 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6e43d16b-ba89-414d-b71c-4e41bc04a656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:07.246995 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f907d94c-8ad7-4860-bb31-083976aec3ee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:07.248209 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f907d94c-8ad7-4860-bb31-083976aec3ee tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1723 microversion: 2.20 time: 0.157943 Jun 06 13:16:07.248764 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 467/954] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:16:07 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1723 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:16:07.252666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6e43d16b-ba89-414d-b71c-4e41bc04a656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:07.253117 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6e43d16b-ba89-414d-b71c-4e41bc04a656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:07.253888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6e43d16b-ba89-414d-b71c-4e41bc04a656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:07.254324 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6e43d16b-ba89-414d-b71c-4e41bc04a656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:07.285688 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6e43d16b-ba89-414d-b71c-4e41bc04a656 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments/6e486da5-328b-40ee-9f86-c299d72bdd05" status: 200 len: 194 microversion: 2.1 time: 0.043604 Jun 06 13:16:07.287106 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 488/955] 10.222.0.13 () {58 vars in 1412 bytes} [Mon Jun 6 13:16:07 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments/6e486da5-328b-40ee-9f86-c299d72bdd05 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:16:07.299505 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e8088bf9-9486-458b-8365-dea268417f2c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:07.299972 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e8088bf9-9486-458b-8365-dea268417f2c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:07.305962 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5c045e4b-af5f-45c6-9ac1-5a8b8deecc69 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:07.306175 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e8088bf9-9486-458b-8365-dea268417f2c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:07.306618 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5c045e4b-af5f-45c6-9ac1-5a8b8deecc69 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:07.306742 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e8088bf9-9486-458b-8365-dea268417f2c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:07.307373 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e8088bf9-9486-458b-8365-dea268417f2c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:07.307832 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e8088bf9-9486-458b-8365-dea268417f2c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:07.312586 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5c045e4b-af5f-45c6-9ac1-5a8b8deecc69 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:07.313771 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5c045e4b-af5f-45c6-9ac1-5a8b8deecc69 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:07.313897 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5c045e4b-af5f-45c6-9ac1-5a8b8deecc69 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:07.314251 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5c045e4b-af5f-45c6-9ac1-5a8b8deecc69 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:07.386470 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5c045e4b-af5f-45c6-9ac1-5a8b8deecc69 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:07.394543 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5c045e4b-af5f-45c6-9ac1-5a8b8deecc69 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1266 microversion: 2.1 time: 0.092221 Jun 06 13:16:07.406186 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 489/956] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:07 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1266 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:16:07.424352 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-e8088bf9-9486-458b-8365-dea268417f2c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lazy-loading 'services' on Instance uuid 1ff2f700-fdee-4fd2-a53f-92620522ffb2 {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:16:07.572914 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1d844d1f-a82c-42cf-b32b-6d726e947f0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:07.573840 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1d844d1f-a82c-42cf-b32b-6d726e947f0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:07.580369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d844d1f-a82c-42cf-b32b-6d726e947f0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:07.580812 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d844d1f-a82c-42cf-b32b-6d726e947f0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:07.581585 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d844d1f-a82c-42cf-b32b-6d726e947f0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:07.582018 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d844d1f-a82c-42cf-b32b-6d726e947f0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:07.613385 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1d844d1f-a82c-42cf-b32b-6d726e947f0e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045088 Jun 06 13:16:07.614152 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 490/957] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:16:07 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:16:07.626273 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e8088bf9-9486-458b-8365-dea268417f2c tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments/6e486da5-328b-40ee-9f86-c299d72bdd05" status: 202 len: 0 microversion: 2.1 time: 0.330671 Jun 06 13:16:07.627106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 468/958] 10.222.0.13 () {58 vars in 1415 bytes} [Mon Jun 6 13:16:07 2022] DELETE /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments/6e486da5-328b-40ee-9f86-c299d72bdd05 => generated 0 bytes in 332 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:16:08.268270 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2362a90f-960b-4032-ab7f-cbc4c7f930c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:08.268270 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2362a90f-960b-4032-ab7f-cbc4c7f930c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:08.274595 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2362a90f-960b-4032-ab7f-cbc4c7f930c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:08.275482 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2362a90f-960b-4032-ab7f-cbc4c7f930c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:08.276812 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2362a90f-960b-4032-ab7f-cbc4c7f930c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:08.277739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2362a90f-960b-4032-ab7f-cbc4c7f930c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:08.294662 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-6aeb8de9-7c60-40c8-abb4-59ad58b02e39 req-1769c7af-0fca-4843-84d0-9f228533c02e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e", "name": "network-vif-deleted", "tag": "ec8a25f8-dea4-4bfd-9075-104851367737"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:16:08.311805 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-6aeb8de9-7c60-40c8-abb4-59ad58b02e39 req-1769c7af-0fca-4843-84d0-9f228533c02e service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:08.313832 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-6aeb8de9-7c60-40c8-abb4-59ad58b02e39 req-1769c7af-0fca-4843-84d0-9f228533c02e service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:08.331065 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-6aeb8de9-7c60-40c8-abb4-59ad58b02e39 req-1769c7af-0fca-4843-84d0-9f228533c02e service nova] Creating event network-vif-deleted:ec8a25f8-dea4-4bfd-9075-104851367737 for instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e on hv-cinder-75510 Jun 06 13:16:08.336998 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-6aeb8de9-7c60-40c8-abb4-59ad58b02e39 req-1769c7af-0fca-4843-84d0-9f228533c02e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.046297 Jun 06 13:16:08.338437 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 469/959] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:16:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:08.375334 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2362a90f-960b-4032-ab7f-cbc4c7f930c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:08.399816 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2362a90f-960b-4032-ab7f-cbc4c7f930c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:08.402584 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2362a90f-960b-4032-ab7f-cbc4c7f930c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '15aec8f2f71e4084a21cc0cfc3a52bd2', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '217a93e9314e4b06ae49a36a9969e22e', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:08.404320 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2362a90f-960b-4032-ab7f-cbc4c7f930c4 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 200 len: 1656 microversion: 2.20 time: 0.141588 Jun 06 13:16:08.429675 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3e59376e-4e0d-405f-892d-35d9eb529ced tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:08.430570 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3e59376e-4e0d-405f-892d-35d9eb529ced tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:08.433544 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 491/960] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:16:08 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 1656 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Jun 06 13:16:08.439840 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3e59376e-4e0d-405f-892d-35d9eb529ced tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:08.440564 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3e59376e-4e0d-405f-892d-35d9eb529ced tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:08.441554 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3e59376e-4e0d-405f-892d-35d9eb529ced tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:08.441982 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3e59376e-4e0d-405f-892d-35d9eb529ced tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:08.534289 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3e59376e-4e0d-405f-892d-35d9eb529ced tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:08.546353 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3e59376e-4e0d-405f-892d-35d9eb529ced tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1272 microversion: 2.1 time: 0.128550 Jun 06 13:16:08.557892 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 470/961] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:08 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1272 bytes in 141 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:08.627881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f09a9fdc-7e4d-4761-9e78-0aaa056f9f77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:08.631296 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f09a9fdc-7e4d-4761-9e78-0aaa056f9f77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:08.636539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:08.636539 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:08.653379 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f09a9fdc-7e4d-4761-9e78-0aaa056f9f77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:08.653829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f09a9fdc-7e4d-4761-9e78-0aaa056f9f77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:08.655308 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f09a9fdc-7e4d-4761-9e78-0aaa056f9f77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:08.655934 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f09a9fdc-7e4d-4761-9e78-0aaa056f9f77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:08.742186 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f09a9fdc-7e4d-4761-9e78-0aaa056f9f77 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.119164 Jun 06 13:16:08.743383 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 492/962] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:16:08 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d/os-volume_attachments => generated 25 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Jun 06 13:16:08.824932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-8ab7ac50-3699-4a2b-a152-2e257a04b27f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:08.825541 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8ab7ac50-3699-4a2b-a152-2e257a04b27f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:08.831249 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:08.834282 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8ab7ac50-3699-4a2b-a152-2e257a04b27f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:08.838239 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8ab7ac50-3699-4a2b-a152-2e257a04b27f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:08.838239 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8ab7ac50-3699-4a2b-a152-2e257a04b27f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:08.838239 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-8ab7ac50-3699-4a2b-a152-2e257a04b27f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:08.852736 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-422137c7-fe9c-46f0-9a10-650e1cc8e181 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:08.854068 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-422137c7-fe9c-46f0-9a10-650e1cc8e181 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:08.861195 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-422137c7-fe9c-46f0-9a10-650e1cc8e181 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:08.866863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-422137c7-fe9c-46f0-9a10-650e1cc8e181 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:08.866863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-422137c7-fe9c-46f0-9a10-650e1cc8e181 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:08.866863 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-422137c7-fe9c-46f0-9a10-650e1cc8e181 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:08.877875 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-8ab7ac50-3699-4a2b-a152-2e257a04b27f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Going to try to terminate instance {{(pid=118134) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:16:08.897657 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-422137c7-fe9c-46f0-9a10-650e1cc8e181 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.049762 Jun 06 13:16:08.898832 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 493/963] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:16:08 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments => generated 25 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 13:16:09.033155 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-06c71d99-548e-4b76-85ae-eface18f69b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:09.034070 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-06c71d99-548e-4b76-85ae-eface18f69b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:09.040307 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-06c71d99-548e-4b76-85ae-eface18f69b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:09.043670 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-06c71d99-548e-4b76-85ae-eface18f69b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:09.043670 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-06c71d99-548e-4b76-85ae-eface18f69b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:09.043670 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-06c71d99-548e-4b76-85ae-eface18f69b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:09.074906 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-06c71d99-548e-4b76-85ae-eface18f69b2 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.045604 Jun 06 13:16:09.075492 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 494/964] 10.222.0.13 () {58 vars in 1301 bytes} [Mon Jun 6 13:16:09 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2/os-volume_attachments => generated 25 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Jun 06 13:16:09.174900 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-64ffb678-0150-48cf-b145-7d948156b93d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:09.174900 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-64ffb678-0150-48cf-b145-7d948156b93d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:09.174900 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-64ffb678-0150-48cf-b145-7d948156b93d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:09.174900 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-64ffb678-0150-48cf-b145-7d948156b93d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:09.184298 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-64ffb678-0150-48cf-b145-7d948156b93d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:09.184765 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-64ffb678-0150-48cf-b145-7d948156b93d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:09.227332 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-64ffb678-0150-48cf-b145-7d948156b93d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:16:09.229804 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-8ab7ac50-3699-4a2b-a152-2e257a04b27f tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 204 len: 0 microversion: 2.1 time: 0.408472 Jun 06 13:16:09.230394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 471/965] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:16:08 2022] DELETE /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 0 bytes in 410 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:16:09.242771 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ad27636b-d78e-4639-90dd-516159d7e654 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:09.243579 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ad27636b-d78e-4639-90dd-516159d7e654 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:09.262088 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ad27636b-d78e-4639-90dd-516159d7e654 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:09.262548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ad27636b-d78e-4639-90dd-516159d7e654 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:09.263334 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ad27636b-d78e-4639-90dd-516159d7e654 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:09.263787 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ad27636b-d78e-4639-90dd-516159d7e654 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:09.423817 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ad27636b-d78e-4639-90dd-516159d7e654 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:09.431137 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ad27636b-d78e-4639-90dd-516159d7e654 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1683 microversion: 2.1 time: 0.196146 Jun 06 13:16:09.431748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 472/966] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:09 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1683 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:09.437074 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-48ce852d-1a60-4a7f-b116-993a48bf3fce tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:09.437981 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-48ce852d-1a60-4a7f-b116-993a48bf3fce tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:09.445072 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-48ce852d-1a60-4a7f-b116-993a48bf3fce tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:09.445738 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-48ce852d-1a60-4a7f-b116-993a48bf3fce tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:09.446696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-48ce852d-1a60-4a7f-b116-993a48bf3fce tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:09.447638 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-48ce852d-1a60-4a7f-b116-993a48bf3fce tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:09.470158 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-48ce852d-1a60-4a7f-b116-993a48bf3fce tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] HTTP exception thrown: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-48ce852d-1a60-4a7f-b116-993a48bf3fce tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Request method failure captured: Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e HTTP/1.1 Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxY0b8lxaR7WehSTVZR5G93jLntY1qQUQSNkURQ8TWHJ6jMHhO2XpEtR95f4dv912W6NJjGIhwThfj6wKqyXoEpTdPq31gXBeyUdMJ9IICKcS6U0BIvqMQe-fBmmsmlqOy3rVYJeW31bL8EmVOSggmZNaZ-n_DFd9lUPCKGQ6sRjHs Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 217a93e9314e4b06ae49a36a9969e22e Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:09.472179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:09.474633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_217a93e9314e4b06ae49a36a9969e22e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/217a93e9314e4b06ae49a36a9969e22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/217a93e9314e4b06ae49a36a9969e22e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/217a93e9314e4b06ae49a36a9969e22e"}]}] Jun 06 13:16:09.474633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:09.474633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 217a93e9314e4b06ae49a36a9969e22e Jun 06 13:16:09.474633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:09.474633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeShelveTestJSON-1209920443-project Jun 06 13:16:09.474633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:09.474633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:09.474633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 15aec8f2f71e4084a21cc0cfc3a52bd2 Jun 06 13:16:09.474633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1209920443-project Jun 06 13:16:09.474633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:09.474633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:09.474633 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e'} Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:09.475848 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:09.478003 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:09.485572 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-48ce852d-1a60-4a7f-b116-993a48bf3fce tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Returning 404 to user: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:09.485572 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-48ce852d-1a60-4a7f-b116-993a48bf3fce tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 404 len: 111 microversion: 2.20 time: 0.040764 Jun 06 13:16:09.485572 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 473/967] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:16:09 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 111 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 13:16:09.485572 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-68dbff91-498f-47a8-9bc6-52e14ee82902 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '.version_select at 0x7f0efc2e8790>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:09.572169 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-68dbff91-498f-47a8-9bc6-52e14ee82902 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809104381" status: 204 len: 0 microversion: 2.20 time: 0.092504 Jun 06 13:16:09.572752 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 474/968] 10.222.0.13 () {60 vars in 1261 bytes} [Mon Jun 6 13:16:09 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1809104381 => generated 0 bytes in 94 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Jun 06 13:16:09.577485 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2ea38c20-b352-4bd8-8e1b-e75b6bcf957c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:09.578480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2ea38c20-b352-4bd8-8e1b-e75b6bcf957c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:09.585495 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-64ffb678-0150-48cf-b145-7d948156b93d tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 204 len: 0 microversion: 2.1 time: 0.427465 Jun 06 13:16:09.586303 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 495/969] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:16:09 2022] DELETE /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 0 bytes in 429 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 13:16:09.596121 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-00c3a873-b7dd-4284-b94d-b3ee4bd8ec27 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:09.596708 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2ea38c20-b352-4bd8-8e1b-e75b6bcf957c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:09.597232 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2ea38c20-b352-4bd8-8e1b-e75b6bcf957c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:09.597580 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-00c3a873-b7dd-4284-b94d-b3ee4bd8ec27 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:09.598294 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2ea38c20-b352-4bd8-8e1b-e75b6bcf957c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:09.599485 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2ea38c20-b352-4bd8-8e1b-e75b6bcf957c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:09.605390 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-00c3a873-b7dd-4284-b94d-b3ee4bd8ec27 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:09.606056 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-00c3a873-b7dd-4284-b94d-b3ee4bd8ec27 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:09.607256 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-00c3a873-b7dd-4284-b94d-b3ee4bd8ec27 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:09.607887 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-00c3a873-b7dd-4284-b94d-b3ee4bd8ec27 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:09.872331 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-00c3a873-b7dd-4284-b94d-b3ee4bd8ec27 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:09.876965 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-2ea38c20-b352-4bd8-8e1b-e75b6bcf957c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:09.881141 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-00c3a873-b7dd-4284-b94d-b3ee4bd8ec27 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1671 microversion: 2.1 time: 0.288709 Jun 06 13:16:09.886073 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 496/970] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:09 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1671 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:09.886206 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2ea38c20-b352-4bd8-8e1b-e75b6bcf957c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1314 microversion: 2.1 time: 0.311952 Jun 06 13:16:09.886335 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 475/971] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:09 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1314 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:10.450643 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2b92a086-d56d-4718-a9ab-c46d06eb6406 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:10.452610 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2b92a086-d56d-4718-a9ab-c46d06eb6406 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:10.464253 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b92a086-d56d-4718-a9ab-c46d06eb6406 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:10.464925 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b92a086-d56d-4718-a9ab-c46d06eb6406 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:10.465917 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b92a086-d56d-4718-a9ab-c46d06eb6406 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:10.466573 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2b92a086-d56d-4718-a9ab-c46d06eb6406 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:10.703457 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2b92a086-d56d-4718-a9ab-c46d06eb6406 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:10.712174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2b92a086-d56d-4718-a9ab-c46d06eb6406 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1683 microversion: 2.1 time: 0.266674 Jun 06 13:16:10.712962 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 497/972] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:10 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1683 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:10.899707 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-03a859aa-9060-47f5-a61a-7ebe6d2ef2a1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:10.900317 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-03a859aa-9060-47f5-a61a-7ebe6d2ef2a1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:10.907025 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bc1497fb-4678-4562-8739-95121139e4b2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:10.908124 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bc1497fb-4678-4562-8739-95121139e4b2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:10.908576 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-03a859aa-9060-47f5-a61a-7ebe6d2ef2a1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:10.909031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-03a859aa-9060-47f5-a61a-7ebe6d2ef2a1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:10.909891 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-03a859aa-9060-47f5-a61a-7ebe6d2ef2a1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:10.910375 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-03a859aa-9060-47f5-a61a-7ebe6d2ef2a1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:10.923416 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bc1497fb-4678-4562-8739-95121139e4b2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:10.927895 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bc1497fb-4678-4562-8739-95121139e4b2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:10.927895 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bc1497fb-4678-4562-8739-95121139e4b2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:10.927895 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bc1497fb-4678-4562-8739-95121139e4b2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:11.176076 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-03a859aa-9060-47f5-a61a-7ebe6d2ef2a1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:11.187375 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-03a859aa-9060-47f5-a61a-7ebe6d2ef2a1 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1671 microversion: 2.1 time: 0.292610 Jun 06 13:16:11.187806 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-bc1497fb-4678-4562-8739-95121139e4b2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:11.200098 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 476/973] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:10 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1671 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:11.203446 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bc1497fb-4678-4562-8739-95121139e4b2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1314 microversion: 2.1 time: 0.304295 Jun 06 13:16:11.204072 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 498/974] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:10 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1314 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:16:11.469084 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-571611e6-2c85-457c-a18f-45903bad1fab req-6226ec83-412d-48f4-8f9b-f0b3bef1a31f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "83546f6a-ff23-4700-b47a-f08f6f3d5b8b", "tag": "5181d25a-ae47-479e-bdfc-0b79fb8bbece"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:16:11.478272 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-571611e6-2c85-457c-a18f-45903bad1fab req-6226ec83-412d-48f4-8f9b-f0b3bef1a31f service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:11.478724 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-571611e6-2c85-457c-a18f-45903bad1fab req-6226ec83-412d-48f4-8f9b-f0b3bef1a31f service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:11.492246 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-571611e6-2c85-457c-a18f-45903bad1fab req-6226ec83-412d-48f4-8f9b-f0b3bef1a31f service nova] Creating event network-changed:5181d25a-ae47-479e-bdfc-0b79fb8bbece for instance 83546f6a-ff23-4700-b47a-f08f6f3d5b8b on hv-cinder-75510 Jun 06 13:16:11.497272 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-571611e6-2c85-457c-a18f-45903bad1fab req-6226ec83-412d-48f4-8f9b-f0b3bef1a31f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032299 Jun 06 13:16:11.497859 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 477/975] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:16:11 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:11.729504 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-166bf9b6-d8fd-4723-b67a-6526e7165857 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:11.730195 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-166bf9b6-d8fd-4723-b67a-6526e7165857 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:11.736058 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-64d182ea-34fe-4cd8-9d90-4d0f2495c84c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:11.736624 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-64d182ea-34fe-4cd8-9d90-4d0f2495c84c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:11.737007 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-166bf9b6-d8fd-4723-b67a-6526e7165857 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:11.737524 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-166bf9b6-d8fd-4723-b67a-6526e7165857 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:11.738417 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-166bf9b6-d8fd-4723-b67a-6526e7165857 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:11.738919 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-166bf9b6-d8fd-4723-b67a-6526e7165857 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:11.743332 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-64d182ea-34fe-4cd8-9d90-4d0f2495c84c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:11.743811 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-64d182ea-34fe-4cd8-9d90-4d0f2495c84c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:11.744563 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-64d182ea-34fe-4cd8-9d90-4d0f2495c84c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:11.744997 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-64d182ea-34fe-4cd8-9d90-4d0f2495c84c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:11.758534 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-64d182ea-34fe-4cd8-9d90-4d0f2495c84c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] HTTP exception thrown: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-64d182ea-34fe-4cd8-9d90-4d0f2495c84c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Request method failure captured: Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: DELETE /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e HTTP/1.1 Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxY0b8lxaR7WehSTVZR5G93jLntY1qQUQSNkURQ8TWHJ6jMHhO2XpEtR95f4dv912W6NJjGIhwThfj6wKqyXoEpTdPq31gXBeyUdMJ9IICKcS6U0BIvqMQe-fBmmsmlqOy3rVYJeW31bL8EmVOSggmZNaZ-n_DFd9lUPCKGQ6sRjHs Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 217a93e9314e4b06ae49a36a9969e22e Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:11.760221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:11.761918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_217a93e9314e4b06ae49a36a9969e22e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/217a93e9314e4b06ae49a36a9969e22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/217a93e9314e4b06ae49a36a9969e22e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/217a93e9314e4b06ae49a36a9969e22e"}]}] Jun 06 13:16:11.761918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:11.761918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 217a93e9314e4b06ae49a36a9969e22e Jun 06 13:16:11.761918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:11.761918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeShelveTestJSON-1209920443-project Jun 06 13:16:11.761918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:11.761918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:11.761918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 15aec8f2f71e4084a21cc0cfc3a52bd2 Jun 06 13:16:11.761918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1209920443-project Jun 06 13:16:11.761918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:11.761918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:11.761918 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e'} Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:11.762820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:11.764411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:11.765903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-64d182ea-34fe-4cd8-9d90-4d0f2495c84c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Returning 404 to user: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:11.765903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-64d182ea-34fe-4cd8-9d90-4d0f2495c84c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "DELETE /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 404 len: 111 microversion: 2.20 time: 0.029726 Jun 06 13:16:11.765903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 478/976] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jun 6 13:16:11 2022] DELETE /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 06 13:16:11.769550 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a10dc11a-69ee-4b49-a53c-fca49014ab05 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:11.770142 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a10dc11a-69ee-4b49-a53c-fca49014ab05 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:11.776071 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a10dc11a-69ee-4b49-a53c-fca49014ab05 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:11.776518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a10dc11a-69ee-4b49-a53c-fca49014ab05 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:11.777271 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a10dc11a-69ee-4b49-a53c-fca49014ab05 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:11.777698 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a10dc11a-69ee-4b49-a53c-fca49014ab05 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:11.793532 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-a10dc11a-69ee-4b49-a53c-fca49014ab05 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] HTTP exception thrown: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a10dc11a-69ee-4b49-a53c-fca49014ab05 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Request method failure captured: Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e HTTP/1.1 Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxY0b8lxaR7WehSTVZR5G93jLntY1qQUQSNkURQ8TWHJ6jMHhO2XpEtR95f4dv912W6NJjGIhwThfj6wKqyXoEpTdPq31gXBeyUdMJ9IICKcS6U0BIvqMQe-fBmmsmlqOy3rVYJeW31bL8EmVOSggmZNaZ-n_DFd9lUPCKGQ6sRjHs Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 217a93e9314e4b06ae49a36a9969e22e Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:11.795046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:11.797157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_217a93e9314e4b06ae49a36a9969e22e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/217a93e9314e4b06ae49a36a9969e22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/217a93e9314e4b06ae49a36a9969e22e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/217a93e9314e4b06ae49a36a9969e22e"}]}] Jun 06 13:16:11.797157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:11.797157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 217a93e9314e4b06ae49a36a9969e22e Jun 06 13:16:11.797157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:11.797157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeShelveTestJSON-1209920443-project Jun 06 13:16:11.797157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:11.797157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:11.797157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 15aec8f2f71e4084a21cc0cfc3a52bd2 Jun 06 13:16:11.797157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1209920443-project Jun 06 13:16:11.797157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:11.797157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:11.797157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e'} Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:11.798193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. Jun 06 13:16:11.799696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:11.801138 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a10dc11a-69ee-4b49-a53c-fca49014ab05 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Returning 404 to user: Instance 71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:11.801138 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a10dc11a-69ee-4b49-a53c-fca49014ab05 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e" status: 404 len: 111 microversion: 2.20 time: 0.030507 Jun 06 13:16:11.801138 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 479/977] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:16:11 2022] GET /compute/v2.1/servers/71b1c0dc-8bb5-4c46-8f9e-c1a9f6753c0e => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 13:16:11.874340 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-166bf9b6-d8fd-4723-b67a-6526e7165857 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:11.882955 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-166bf9b6-d8fd-4723-b67a-6526e7165857 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1683 microversion: 2.1 time: 0.157324 Jun 06 13:16:11.883602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 499/978] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:11 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1683 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:12.204554 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-09c907f4-8828-4cf0-93c8-0a4ead111ca9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:12.205315 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-09c907f4-8828-4cf0-93c8-0a4ead111ca9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:12.213426 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-09c907f4-8828-4cf0-93c8-0a4ead111ca9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:12.215609 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-09c907f4-8828-4cf0-93c8-0a4ead111ca9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:12.216771 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-09c907f4-8828-4cf0-93c8-0a4ead111ca9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:12.217313 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-09c907f4-8828-4cf0-93c8-0a4ead111ca9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:12.224304 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f28e7d32-a4a7-4df4-b160-954f8f4a215c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:12.225556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f28e7d32-a4a7-4df4-b160-954f8f4a215c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:12.232919 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f28e7d32-a4a7-4df4-b160-954f8f4a215c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:12.233644 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f28e7d32-a4a7-4df4-b160-954f8f4a215c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:12.234884 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f28e7d32-a4a7-4df4-b160-954f8f4a215c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:12.235479 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f28e7d32-a4a7-4df4-b160-954f8f4a215c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:12.240641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:12.497668 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f28e7d32-a4a7-4df4-b160-954f8f4a215c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:12.508024 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f28e7d32-a4a7-4df4-b160-954f8f4a215c tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1314 microversion: 2.1 time: 0.289358 Jun 06 13:16:12.508937 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 500/979] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:12 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:16:12.540840 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-09c907f4-8828-4cf0-93c8-0a4ead111ca9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:12.549279 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-09c907f4-8828-4cf0-93c8-0a4ead111ca9 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1671 microversion: 2.1 time: 0.348804 Jun 06 13:16:12.549849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 480/980] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:12 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1671 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:12.906888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-eee4a049-8fbb-48af-a5e6-63d616377afb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:12.907886 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-eee4a049-8fbb-48af-a5e6-63d616377afb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:12.920949 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eee4a049-8fbb-48af-a5e6-63d616377afb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:12.921398 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eee4a049-8fbb-48af-a5e6-63d616377afb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:12.922497 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eee4a049-8fbb-48af-a5e6-63d616377afb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:12.922934 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-eee4a049-8fbb-48af-a5e6-63d616377afb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:13.020177 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-112a4788-33cc-42e7-bfce-543370ec6ae3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:13.020664 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-112a4788-33cc-42e7-bfce-543370ec6ae3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:13.026852 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-112a4788-33cc-42e7-bfce-543370ec6ae3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:13.027302 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-112a4788-33cc-42e7-bfce-543370ec6ae3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:13.028110 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-112a4788-33cc-42e7-bfce-543370ec6ae3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:13.028551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-112a4788-33cc-42e7-bfce-543370ec6ae3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:13.043306 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-112a4788-33cc-42e7-bfce-543370ec6ae3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] HTTP exception thrown: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-112a4788-33cc-42e7-bfce-543370ec6ae3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Request method failure captured: Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: DELETE /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 HTTP/1.1 Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxY0b8lxaR7WehSTVZR5G93jLntY1qQUQSNkURQ8TWHJ6jMHhO2XpEtR95f4dv912W6NJjGIhwThfj6wKqyXoEpTdPq31gXBeyUdMJ9IICKcS6U0BIvqMQe-fBmmsmlqOy3rVYJeW31bL8EmVOSggmZNaZ-n_DFd9lUPCKGQ6sRjHs Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 217a93e9314e4b06ae49a36a9969e22e Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:13.044933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:13.047008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_217a93e9314e4b06ae49a36a9969e22e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/217a93e9314e4b06ae49a36a9969e22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/217a93e9314e4b06ae49a36a9969e22e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/217a93e9314e4b06ae49a36a9969e22e"}]}] Jun 06 13:16:13.047008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:13.047008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 217a93e9314e4b06ae49a36a9969e22e Jun 06 13:16:13.047008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:13.047008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeShelveTestJSON-1209920443-project Jun 06 13:16:13.047008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:13.047008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:13.047008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 15aec8f2f71e4084a21cc0cfc3a52bd2 Jun 06 13:16:13.047008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1209920443-project Jun 06 13:16:13.047008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:13.047008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:16:13.047008 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '8fc5ce11-0a01-44fd-9be7-c095a8254551'} Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:13.052947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:16:13.054548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:13.056356 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-112a4788-33cc-42e7-bfce-543370ec6ae3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Returning 404 to user: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:13.056356 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-112a4788-33cc-42e7-bfce-543370ec6ae3 tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "DELETE /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 404 len: 111 microversion: 2.20 time: 0.030065 Jun 06 13:16:13.056356 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 481/981] 10.222.0.13 () {60 vars in 1279 bytes} [Mon Jun 6 13:16:13 2022] DELETE /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Jun 06 13:16:13.056732 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d8c3cc8b-8a75-41bb-8555-a9ae30eb962c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:13.057342 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-d8c3cc8b-8a75-41bb-8555-a9ae30eb962c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] [instance: 8fc5ce11-0a01-44fd-9be7-c095a8254551] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:13.064035 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d8c3cc8b-8a75-41bb-8555-a9ae30eb962c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:13.064665 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d8c3cc8b-8a75-41bb-8555-a9ae30eb962c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:13.065588 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d8c3cc8b-8a75-41bb-8555-a9ae30eb962c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:13.066320 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-d8c3cc8b-8a75-41bb-8555-a9ae30eb962c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:13.080086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-eee4a049-8fbb-48af-a5e6-63d616377afb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:13.082942 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-d8c3cc8b-8a75-41bb-8555-a9ae30eb962c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] HTTP exception thrown: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d8c3cc8b-8a75-41bb-8555-a9ae30eb962c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Request method failure captured: Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 HTTP/1.1 Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxY0b8lxaR7WehSTVZR5G93jLntY1qQUQSNkURQ8TWHJ6jMHhO2XpEtR95f4dv912W6NJjGIhwThfj6wKqyXoEpTdPq31gXBeyUdMJ9IICKcS6U0BIvqMQe-fBmmsmlqOy3rVYJeW31bL8EmVOSggmZNaZ-n_DFd9lUPCKGQ6sRjHs Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Openstack-Nova-Api-Version: 2.20 Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 217a93e9314e4b06ae49a36a9969e22e Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:13.085310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:13.087089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_217a93e9314e4b06ae49a36a9969e22e", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/217a93e9314e4b06ae49a36a9969e22e"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/217a93e9314e4b06ae49a36a9969e22e"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/217a93e9314e4b06ae49a36a9969e22e"}]}] Jun 06 13:16:13.087089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:13.087089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 217a93e9314e4b06ae49a36a9969e22e Jun 06 13:16:13.087089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-1209920443 Jun 06 13:16:13.087089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeShelveTestJSON-1209920443-project Jun 06 13:16:13.087089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:13.087089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:13.087089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 15aec8f2f71e4084a21cc0cfc3a52bd2 Jun 06 13:16:13.087089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeShelveTestJSON-1209920443-project Jun 06 13:16:13.087089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:13.087089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:16:13.087089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '8fc5ce11-0a01-44fd-9be7-c095a8254551'} Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:13.087985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. Jun 06 13:16:13.089520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:13.090995 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-d8c3cc8b-8a75-41bb-8555-a9ae30eb962c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] Returning 404 to user: Instance 8fc5ce11-0a01-44fd-9be7-c095a8254551 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:13.090995 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-d8c3cc8b-8a75-41bb-8555-a9ae30eb962c tempest-AttachVolumeShelveTestJSON-1209920443 tempest-AttachVolumeShelveTestJSON-1209920443-project] 10.222.0.13 "GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551" status: 404 len: 111 microversion: 2.20 time: 0.035153 Jun 06 13:16:13.091827 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 482/982] 10.222.0.13 () {60 vars in 1276 bytes} [Mon Jun 6 13:16:13 2022] GET /compute/v2.1/servers/8fc5ce11-0a01-44fd-9be7-c095a8254551 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Jun 06 13:16:13.093573 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-eee4a049-8fbb-48af-a5e6-63d616377afb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1683 microversion: 2.1 time: 0.195543 Jun 06 13:16:13.106966 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 501/983] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:12 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1683 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:16:13.538845 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0206db51-e842-4308-b0a8-8db3847f4f20 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:13.542799 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0206db51-e842-4308-b0a8-8db3847f4f20 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:13.553013 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0206db51-e842-4308-b0a8-8db3847f4f20 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:13.553752 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0206db51-e842-4308-b0a8-8db3847f4f20 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:13.555129 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0206db51-e842-4308-b0a8-8db3847f4f20 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:13.555851 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0206db51-e842-4308-b0a8-8db3847f4f20 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:13.566144 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-aa18a4ff-eacf-421b-935d-cf5e59533a2e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:13.566750 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-aa18a4ff-eacf-421b-935d-cf5e59533a2e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:13.589513 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa18a4ff-eacf-421b-935d-cf5e59533a2e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:13.590233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa18a4ff-eacf-421b-935d-cf5e59533a2e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:13.591365 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa18a4ff-eacf-421b-935d-cf5e59533a2e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:13.592172 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa18a4ff-eacf-421b-935d-cf5e59533a2e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:13.718055 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-aa18a4ff-eacf-421b-935d-cf5e59533a2e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:13.736427 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-aa18a4ff-eacf-421b-935d-cf5e59533a2e tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1605 microversion: 2.1 time: 0.173795 Jun 06 13:16:13.747118 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 502/984] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:13 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1605 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:13.962178 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-0206db51-e842-4308-b0a8-8db3847f4f20 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:13.965750 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:13.977476 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-54496ca0-5b6e-4138-8925-129873c764a3 req-da7aa87e-61a6-4c27-99d9-44e12a7156b1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "9c6f51ea-9ed2-4db7-84ac-f8c4e438741d", "name": "network-vif-deleted", "tag": "7c1f42d9-3d50-49f7-bf0a-b51558b54975"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:16:13.982625 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0206db51-e842-4308-b0a8-8db3847f4f20 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1314 microversion: 2.1 time: 0.452715 Jun 06 13:16:13.984106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 483/985] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:13 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1314 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:13.990590 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-54496ca0-5b6e-4138-8925-129873c764a3 req-da7aa87e-61a6-4c27-99d9-44e12a7156b1 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:13.990977 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-54496ca0-5b6e-4138-8925-129873c764a3 req-da7aa87e-61a6-4c27-99d9-44e12a7156b1 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:14.006913 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-54496ca0-5b6e-4138-8925-129873c764a3 req-da7aa87e-61a6-4c27-99d9-44e12a7156b1 service nova] Creating event network-vif-deleted:7c1f42d9-3d50-49f7-bf0a-b51558b54975 for instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d on hv-cinder-75510 Jun 06 13:16:14.013023 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-54496ca0-5b6e-4138-8925-129873c764a3 req-da7aa87e-61a6-4c27-99d9-44e12a7156b1 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.039932 Jun 06 13:16:14.014089 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 503/986] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:16:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:16:14.116929 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ca176c31-eadd-4670-94d9-f95e62e7df54 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:14.118153 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ca176c31-eadd-4670-94d9-f95e62e7df54 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:14.126690 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ca176c31-eadd-4670-94d9-f95e62e7df54 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:14.128238 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ca176c31-eadd-4670-94d9-f95e62e7df54 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:14.128460 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ca176c31-eadd-4670-94d9-f95e62e7df54 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:14.129282 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ca176c31-eadd-4670-94d9-f95e62e7df54 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:14.222486 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ca176c31-eadd-4670-94d9-f95e62e7df54 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '9c620175b84d4cee9aef398864c03c8d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'd6db503a0a1749789e92ed63f5a113b7', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:14.231307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ca176c31-eadd-4670-94d9-f95e62e7df54 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 200 len: 1615 microversion: 2.1 time: 0.121419 Jun 06 13:16:14.235401 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 484/987] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:14 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 1615 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:14.758202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ca199cce-b1f1-4dae-8503-50dc9c55a258 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:14.759710 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ca199cce-b1f1-4dae-8503-50dc9c55a258 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:14.772147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca199cce-b1f1-4dae-8503-50dc9c55a258 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:14.772739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca199cce-b1f1-4dae-8503-50dc9c55a258 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:14.773688 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca199cce-b1f1-4dae-8503-50dc9c55a258 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:14.777451 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca199cce-b1f1-4dae-8503-50dc9c55a258 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:14.843325 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca199cce-b1f1-4dae-8503-50dc9c55a258 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:14.844158 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ca199cce-b1f1-4dae-8503-50dc9c55a258 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:14.844793 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-ca199cce-b1f1-4dae-8503-50dc9c55a258 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lazy-loading 'fault' on Instance uuid 1ff2f700-fdee-4fd2-a53f-92620522ffb2 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:16:15.001095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-13a34c32-e8e7-4ed5-8b44-62896d4c5d01 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:15.002342 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-13a34c32-e8e7-4ed5-8b44-62896d4c5d01 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:15.011027 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-13a34c32-e8e7-4ed5-8b44-62896d4c5d01 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:15.011757 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-13a34c32-e8e7-4ed5-8b44-62896d4c5d01 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:15.012778 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-13a34c32-e8e7-4ed5-8b44-62896d4c5d01 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:15.013442 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-13a34c32-e8e7-4ed5-8b44-62896d4c5d01 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:15.287626 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ca199cce-b1f1-4dae-8503-50dc9c55a258 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '288ab671062d409f98b91aeacde8b5fc', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2b88389a00a342e285e0c31b90368f87', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:15.310730 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ca199cce-b1f1-4dae-8503-50dc9c55a258 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 200 len: 1327 microversion: 2.1 time: 0.556478 Jun 06 13:16:15.316129 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 504/988] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:14 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 1327 bytes in 559 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:15.321304 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-47859b4b-b295-409a-951a-b2ab15932e4d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:15.322640 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-47859b4b-b295-409a-951a-b2ab15932e4d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:15.335890 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47859b4b-b295-409a-951a-b2ab15932e4d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:15.336503 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47859b4b-b295-409a-951a-b2ab15932e4d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:15.337391 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47859b4b-b295-409a-951a-b2ab15932e4d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:15.337910 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-47859b4b-b295-409a-951a-b2ab15932e4d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:15.355399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-47859b4b-b295-409a-951a-b2ab15932e4d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-47859b4b-b295-409a-951a-b2ab15932e4d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d HTTP/1.1 Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:16:15.357619 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:16:15.359026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:16:15.359026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:15.359026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:15.359026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:15.359026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:15.359026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:16:15.359026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:16:15.359026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:16:15.359026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:15.359026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:16:15.359026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:15.359026 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': '9c6f51ea-9ed2-4db7-84ac-f8c4e438741d'} Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:15.360261 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:15.361563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:15.363748 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-47859b4b-b295-409a-951a-b2ab15932e4d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 404 to user: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:15.364846 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-47859b4b-b295-409a-951a-b2ab15932e4d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 404 len: 111 microversion: 2.1 time: 0.051862 Jun 06 13:16:15.365685 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 505/989] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:15 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:15.374437 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-171b5d5c-99b1-4f98-8cfc-b9214e92c3de tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '.version_select at 0x7f0ef6e1b040>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:15.381460 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=95,nova_api:INSERT=3,nova_api:UPDATE=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:15.446588 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-171b5d5c-99b1-4f98-8cfc-b9214e92c3de tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020361954" status: 202 len: 0 microversion: 2.1 time: 0.076187 Jun 06 13:16:15.447549 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 506/990] 10.222.0.13 () {58 vars in 1220 bytes} [Mon Jun 6 13:16:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1020361954 => generated 0 bytes in 78 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:16:15.458488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-13a34c32-e8e7-4ed5-8b44-62896d4c5d01 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:15.468048 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-13a34c32-e8e7-4ed5-8b44-62896d4c5d01 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1314 microversion: 2.1 time: 0.470420 Jun 06 13:16:15.468992 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 485/991] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:14 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1314 bytes in 473 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:16:16.074339 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-9572707c-ad02-49f6-80e7-19cd8f6b4df5 req-b7db09b0-b265-4981-85a6-c5c5ff68dbf8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ff2f700-fdee-4fd2-a53f-92620522ffb2", "name": "network-vif-deleted", "tag": "fb38f6a3-74c0-42c3-815b-dee79d43ae81"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:16:16.092233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-9572707c-ad02-49f6-80e7-19cd8f6b4df5 req-b7db09b0-b265-4981-85a6-c5c5ff68dbf8 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:16.092892 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-9572707c-ad02-49f6-80e7-19cd8f6b4df5 req-b7db09b0-b265-4981-85a6-c5c5ff68dbf8 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:16.108314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-9572707c-ad02-49f6-80e7-19cd8f6b4df5 req-b7db09b0-b265-4981-85a6-c5c5ff68dbf8 service nova] Creating event network-vif-deleted:fb38f6a3-74c0-42c3-815b-dee79d43ae81 for instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 on hv-cinder-75510 Jun 06 13:16:16.116684 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-9572707c-ad02-49f6-80e7-19cd8f6b4df5 req-b7db09b0-b265-4981-85a6-c5c5ff68dbf8 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.058811 Jun 06 13:16:16.118316 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 507/992] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:16.338806 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-da18f116-35c7-4c85-a981-88c9f51c88e0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:16.339452 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-da18f116-35c7-4c85-a981-88c9f51c88e0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:16.345885 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-da18f116-35c7-4c85-a981-88c9f51c88e0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:16.346341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-da18f116-35c7-4c85-a981-88c9f51c88e0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:16.347101 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-da18f116-35c7-4c85-a981-88c9f51c88e0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:16.347547 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-da18f116-35c7-4c85-a981-88c9f51c88e0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:16.363362 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-da18f116-35c7-4c85-a981-88c9f51c88e0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] HTTP exception thrown: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-da18f116-35c7-4c85-a981-88c9f51c88e0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Request method failure captured: Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 HTTP/1.1 Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxbTNndWrSTGdcCk2Zy0fCQdJIvkGnzW92hqqjvYLTdjslmnrOVe54bpoAtzcdHg9dcoTC05j8bt1azp98k1P01zAsB0TULfuqhMcSXNzh6C-_uzTO-7MyNHNSCkLhqbWGcsLUb0aHSUi5pzziJw1W1_gx5YajMqdnK-lmwN0HcyWY Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 2b88389a00a342e285e0c31b90368f87 Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:16.365500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:16.367128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2b88389a00a342e285e0c31b90368f87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b88389a00a342e285e0c31b90368f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b88389a00a342e285e0c31b90368f87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2b88389a00a342e285e0c31b90368f87"}]}] Jun 06 13:16:16.367128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:16.367128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 2b88389a00a342e285e0c31b90368f87 Jun 06 13:16:16.367128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:16.367128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeTestJSON-1237312882-project Jun 06 13:16:16.367128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:16.367128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:16.367128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 288ab671062d409f98b91aeacde8b5fc Jun 06 13:16:16.367128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeTestJSON-1237312882-project Jun 06 13:16:16.367128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:16.367128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:16.367128 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '1ff2f700-fdee-4fd2-a53f-92620522ffb2'} Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:16.368394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:16.370179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:16.372730 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-da18f116-35c7-4c85-a981-88c9f51c88e0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Returning 404 to user: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:16.372730 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-da18f116-35c7-4c85-a981-88c9f51c88e0 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 404 len: 111 microversion: 2.1 time: 0.032519 Jun 06 13:16:16.372730 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 486/993] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:16 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:16.377563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-65439f66-1c39-4905-a181-231c4142b055 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '.version_select at 0x7f0ef6e1b820>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:16.475817 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-65439f66-1c39-4905-a181-231c4142b055 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-715219307" status: 202 len: 0 microversion: 2.1 time: 0.103499 Jun 06 13:16:16.476652 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 508/994] 10.222.0.13 () {58 vars in 1217 bytes} [Mon Jun 6 13:16:16 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-715219307 => generated 0 bytes in 105 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:16:16.486325 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4868edf7-e1c8-4213-827f-386c425cfa73 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:16.487088 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-4868edf7-e1c8-4213-827f-386c425cfa73 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:16.495018 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4868edf7-e1c8-4213-827f-386c425cfa73 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:16.495629 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4868edf7-e1c8-4213-827f-386c425cfa73 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:16.496763 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4868edf7-e1c8-4213-827f-386c425cfa73 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:16.497284 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4868edf7-e1c8-4213-827f-386c425cfa73 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:16.689907 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-4868edf7-e1c8-4213-827f-386c425cfa73 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:16.699983 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-4868edf7-e1c8-4213-827f-386c425cfa73 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1314 microversion: 2.1 time: 0.216256 Jun 06 13:16:16.700747 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 487/995] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:16 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1314 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:16.983134 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-7d23d5d8-bb7f-4b77-9a92-bf67a46eaf0d req-f2935b3c-5be2-4cac-97fd-3d649099a812 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83546f6a-ff23-4700-b47a-f08f6f3d5b8b", "name": "network-vif-plugged", "status": "completed", "tag": "5181d25a-ae47-479e-bdfc-0b79fb8bbece"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:16:16.992498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-7d23d5d8-bb7f-4b77-9a92-bf67a46eaf0d req-f2935b3c-5be2-4cac-97fd-3d649099a812 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:16.992947 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-7d23d5d8-bb7f-4b77-9a92-bf67a46eaf0d req-f2935b3c-5be2-4cac-97fd-3d649099a812 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:17.004028 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-7d23d5d8-bb7f-4b77-9a92-bf67a46eaf0d req-f2935b3c-5be2-4cac-97fd-3d649099a812 service nova] Creating event network-vif-plugged:5181d25a-ae47-479e-bdfc-0b79fb8bbece for instance 83546f6a-ff23-4700-b47a-f08f6f3d5b8b on hv-cinder-75510 Jun 06 13:16:17.010885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-7d23d5d8-bb7f-4b77-9a92-bf67a46eaf0d req-f2935b3c-5be2-4cac-97fd-3d649099a812 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031646 Jun 06 13:16:17.011470 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 509/996] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:16:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:17.652359 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0e830e73-8fb2-4f2c-932c-f83a6c5b1fd3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:17.653132 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0e830e73-8fb2-4f2c-932c-f83a6c5b1fd3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:17.661358 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0e830e73-8fb2-4f2c-932c-f83a6c5b1fd3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:17.661989 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0e830e73-8fb2-4f2c-932c-f83a6c5b1fd3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:17.662843 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0e830e73-8fb2-4f2c-932c-f83a6c5b1fd3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:17.663355 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0e830e73-8fb2-4f2c-932c-f83a6c5b1fd3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:17.688549 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-0e830e73-8fb2-4f2c-932c-f83a6c5b1fd3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0e830e73-8fb2-4f2c-932c-f83a6c5b1fd3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: DELETE /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d HTTP/1.1 Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:17.690096 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:17.691791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:16:17.691791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:17.691791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:17.691791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:17.691791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:17.691791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:17.691791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:17.691791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:16:17.691791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:17.691791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:17.691791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:17.691791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '9c6f51ea-9ed2-4db7-84ac-f8c4e438741d'} Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:17.693729 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:17.695218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:17.696702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0e830e73-8fb2-4f2c-932c-f83a6c5b1fd3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 404 to user: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:17.696702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0e830e73-8fb2-4f2c-932c-f83a6c5b1fd3 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 404 len: 111 microversion: 2.1 time: 0.043092 Jun 06 13:16:17.696702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 488/997] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:16:17 2022] DELETE /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:17.703551 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-961a2978-7284-4ff2-9eb4-1f32e1ee440e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:17.705779 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-961a2978-7284-4ff2-9eb4-1f32e1ee440e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:17.711136 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-961a2978-7284-4ff2-9eb4-1f32e1ee440e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:17.711491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-961a2978-7284-4ff2-9eb4-1f32e1ee440e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:17.712304 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-961a2978-7284-4ff2-9eb4-1f32e1ee440e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:17.712834 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-961a2978-7284-4ff2-9eb4-1f32e1ee440e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:17.718198 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b4d5e842-4e2e-4617-9e36-ef181ed995f0 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:17.718950 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b4d5e842-4e2e-4617-9e36-ef181ed995f0 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:17.725852 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b4d5e842-4e2e-4617-9e36-ef181ed995f0 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:17.728566 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b4d5e842-4e2e-4617-9e36-ef181ed995f0 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:17.728566 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b4d5e842-4e2e-4617-9e36-ef181ed995f0 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:17.728566 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b4d5e842-4e2e-4617-9e36-ef181ed995f0 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:17.728837 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-961a2978-7284-4ff2-9eb4-1f32e1ee440e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-961a2978-7284-4ff2-9eb4-1f32e1ee440e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d HTTP/1.1 Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:16:17.729885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:16:17.731263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:16:17.731263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:17.731263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:17.731263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:17.731263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:17.731263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:16:17.731263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:16:17.731263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:16:17.731263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:17.731263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:16:17.731263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:17.731263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': '9c6f51ea-9ed2-4db7-84ac-f8c4e438741d'} Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:17.732318 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. Jun 06 13:16:17.733831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:17.735961 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-961a2978-7284-4ff2-9eb4-1f32e1ee440e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 404 to user: Instance 9c6f51ea-9ed2-4db7-84ac-f8c4e438741d could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:17.736846 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-961a2978-7284-4ff2-9eb4-1f32e1ee440e tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d" status: 404 len: 111 microversion: 2.1 time: 0.039251 Jun 06 13:16:17.737441 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 510/998] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:17 2022] GET /compute/v2.1/servers/9c6f51ea-9ed2-4db7-84ac-f8c4e438741d => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:17.926139 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b4d5e842-4e2e-4617-9e36-ef181ed995f0 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:17.934213 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b4d5e842-4e2e-4617-9e36-ef181ed995f0 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1314 microversion: 2.1 time: 0.220037 Jun 06 13:16:17.934783 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 489/999] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:17 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1314 bytes in 221 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:16:18.950077 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-45e311b4-26d5-43ce-b03c-34e538581d80 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:18.950644 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-45e311b4-26d5-43ce-b03c-34e538581d80 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:18.957433 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45e311b4-26d5-43ce-b03c-34e538581d80 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:18.958415 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45e311b4-26d5-43ce-b03c-34e538581d80 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:18.959268 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45e311b4-26d5-43ce-b03c-34e538581d80 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:18.959722 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-45e311b4-26d5-43ce-b03c-34e538581d80 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:19.058337 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9861f52f-0b38-422e-bf59-f5712e597dcb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:19.058896 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9861f52f-0b38-422e-bf59-f5712e597dcb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:19.065994 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9861f52f-0b38-422e-bf59-f5712e597dcb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:19.066441 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9861f52f-0b38-422e-bf59-f5712e597dcb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:19.067671 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9861f52f-0b38-422e-bf59-f5712e597dcb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:19.067942 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9861f52f-0b38-422e-bf59-f5712e597dcb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:19.084534 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-9861f52f-0b38-422e-bf59-f5712e597dcb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9861f52f-0b38-422e-bf59-f5712e597dcb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: DELETE /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c HTTP/1.1 Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:19.086087 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:19.087470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:16:19.087470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:19.087470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:19.087470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:19.087470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:19.087470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:19.087470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:19.087470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:16:19.087470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:19.087470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:19.087470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:16:19.087470 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': 'd70800c6-f31a-4b07-9a99-98a2e5ff905c'} Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:19.088368 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:16:19.089631 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.091948 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9861f52f-0b38-422e-bf59-f5712e597dcb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 404 to user: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:19.091948 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9861f52f-0b38-422e-bf59-f5712e597dcb tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 404 len: 111 microversion: 2.1 time: 0.044422 Jun 06 13:16:19.091948 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 490/1000] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:16:19 2022] DELETE /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 111 bytes in 49 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 13:16:19.096012 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bc25c5b3-7381-4e1b-999f-094265a760cc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:19.096621 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-bc25c5b3-7381-4e1b-999f-094265a760cc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: d70800c6-f31a-4b07-9a99-98a2e5ff905c] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:19.106469 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bc25c5b3-7381-4e1b-999f-094265a760cc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:19.106469 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bc25c5b3-7381-4e1b-999f-094265a760cc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:19.106469 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bc25c5b3-7381-4e1b-999f-094265a760cc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:19.106469 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-bc25c5b3-7381-4e1b-999f-094265a760cc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:19.110729 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-45e311b4-26d5-43ce-b03c-34e538581d80 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:19.119591 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-45e311b4-26d5-43ce-b03c-34e538581d80 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1314 microversion: 2.1 time: 0.173224 Jun 06 13:16:19.120521 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 511/1001] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:18 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1314 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:19.132409 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-bc25c5b3-7381-4e1b-999f-094265a760cc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bc25c5b3-7381-4e1b-999f-094265a760cc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c HTTP/1.1 Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:19.134028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:19.135597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:16:19.135597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:19.135597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:19.135597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:19.135597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:19.135597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:19.135597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:19.135597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:16:19.135597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:19.135597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:19.135597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:16:19.135597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': 'd70800c6-f31a-4b07-9a99-98a2e5ff905c'} Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:19.136422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. Jun 06 13:16:19.138050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.139407 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-bc25c5b3-7381-4e1b-999f-094265a760cc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 404 to user: Instance d70800c6-f31a-4b07-9a99-98a2e5ff905c could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:19.139407 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-bc25c5b3-7381-4e1b-999f-094265a760cc tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c" status: 404 len: 111 microversion: 2.1 time: 0.043402 Jun 06 13:16:19.139407 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 491/1002] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:19 2022] GET /compute/v2.1/servers/d70800c6-f31a-4b07-9a99-98a2e5ff905c => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 13:16:19.144514 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f5a259da-314e-424c-9494-2eb0dca758b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:19.145014 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f5a259da-314e-424c-9494-2eb0dca758b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:19.151885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5a259da-314e-424c-9494-2eb0dca758b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:19.152332 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5a259da-314e-424c-9494-2eb0dca758b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:19.153112 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5a259da-314e-424c-9494-2eb0dca758b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:19.153549 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f5a259da-314e-424c-9494-2eb0dca758b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:19.167890 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-f5a259da-314e-424c-9494-2eb0dca758b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f5a259da-314e-424c-9494-2eb0dca758b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db HTTP/1.1 Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:16:19.172399 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:16:19.173796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:16:19.173796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:19.173796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:19.173796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:19.173796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:19.173796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:16:19.173796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:16:19.173796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:16:19.173796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:19.173796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:16:19.173796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:16:19.173796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': '02dfda62-0a51-417a-807a-c653d5fc26db'} Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:19.174615 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:16:19.175888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.177180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f5a259da-314e-424c-9494-2eb0dca758b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 404 to user: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:19.177180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f5a259da-314e-424c-9494-2eb0dca758b4 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 404 len: 111 microversion: 2.1 time: 0.030211 Jun 06 13:16:19.177180 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 512/1003] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:16:19 2022] DELETE /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:19.179780 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-03852942-035b-408c-a291-82a23577f33d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:19.180391 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-03852942-035b-408c-a291-82a23577f33d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: 02dfda62-0a51-417a-807a-c653d5fc26db] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:19.186519 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-03852942-035b-408c-a291-82a23577f33d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:19.186965 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-03852942-035b-408c-a291-82a23577f33d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:19.189917 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-03852942-035b-408c-a291-82a23577f33d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:19.189917 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-03852942-035b-408c-a291-82a23577f33d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:19.201491 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-03852942-035b-408c-a291-82a23577f33d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-03852942-035b-408c-a291-82a23577f33d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db HTTP/1.1 Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:19.203010 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:19.204723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:16:19.204723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:19.204723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:19.204723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:19.204723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:19.204723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:19.204723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:19.204723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:16:19.204723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:19.204723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:19.204723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:16:19.204723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '02dfda62-0a51-417a-807a-c653d5fc26db'} Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:19.205637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. Jun 06 13:16:19.207363 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:19.219832 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-03852942-035b-408c-a291-82a23577f33d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 404 to user: Instance 02dfda62-0a51-417a-807a-c653d5fc26db could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:19.219832 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-03852942-035b-408c-a291-82a23577f33d tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db" status: 404 len: 111 microversion: 2.1 time: 0.028615 Jun 06 13:16:19.219832 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 492/1004] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:19 2022] GET /compute/v2.1/servers/02dfda62-0a51-417a-807a-c653d5fc26db => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:19.838020 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b5a5e98e-203c-42b0-a562-049da2156858 tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] Action: 'create', calling method: .version_select at 0x7f0efc0b5dc0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1671645788", "metadata": {"Type": "work"}}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:16:20.006480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-455c892f-f3ca-4f57-9320-5c885ea3901b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:20.006975 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-455c892f-f3ca-4f57-9320-5c885ea3901b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:20.013103 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-455c892f-f3ca-4f57-9320-5c885ea3901b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.013551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-455c892f-f3ca-4f57-9320-5c885ea3901b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.014356 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-455c892f-f3ca-4f57-9320-5c885ea3901b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.014792 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-455c892f-f3ca-4f57-9320-5c885ea3901b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.028735 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-455c892f-f3ca-4f57-9320-5c885ea3901b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] HTTP exception thrown: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-455c892f-f3ca-4f57-9320-5c885ea3901b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Request method failure captured: Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: DELETE /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 HTTP/1.1 Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxbTNndWrSTGdcCk2Zy0fCQdJIvkGnzW92hqqjvYLTdjslmnrOVe54bpoAtzcdHg9dcoTC05j8bt1azp98k1P01zAsB0TULfuqhMcSXNzh6C-_uzTO-7MyNHNSCkLhqbWGcsLUb0aHSUi5pzziJw1W1_gx5YajMqdnK-lmwN0HcyWY Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 2b88389a00a342e285e0c31b90368f87 Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:20.030299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:20.031772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2b88389a00a342e285e0c31b90368f87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b88389a00a342e285e0c31b90368f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b88389a00a342e285e0c31b90368f87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2b88389a00a342e285e0c31b90368f87"}]}] Jun 06 13:16:20.031772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:20.031772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 2b88389a00a342e285e0c31b90368f87 Jun 06 13:16:20.031772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:20.031772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeTestJSON-1237312882-project Jun 06 13:16:20.031772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:20.031772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:20.031772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 288ab671062d409f98b91aeacde8b5fc Jun 06 13:16:20.031772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeTestJSON-1237312882-project Jun 06 13:16:20.031772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:20.031772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:20.031772 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '1ff2f700-fdee-4fd2-a53f-92620522ffb2'} Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:20.036425 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:20.037765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.038986 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-455c892f-f3ca-4f57-9320-5c885ea3901b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Returning 404 to user: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:20.038986 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-455c892f-f3ca-4f57-9320-5c885ea3901b tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "DELETE /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 404 len: 111 microversion: 2.1 time: 0.029522 Jun 06 13:16:20.038986 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 493/1005] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:16:20 2022] DELETE /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 13:16:20.039836 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-febdd050-14fc-4934-a2a6-f562ddda29c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:20.040441 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-febdd050-14fc-4934-a2a6-f562ddda29c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 1ff2f700-fdee-4fd2-a53f-92620522ffb2] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:20.046442 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-febdd050-14fc-4934-a2a6-f562ddda29c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.046909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-febdd050-14fc-4934-a2a6-f562ddda29c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.047992 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-febdd050-14fc-4934-a2a6-f562ddda29c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.048443 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-febdd050-14fc-4934-a2a6-f562ddda29c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.062287 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-febdd050-14fc-4934-a2a6-f562ddda29c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] HTTP exception thrown: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-febdd050-14fc-4934-a2a6-f562ddda29c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Request method failure captured: Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 HTTP/1.1 Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxbTNndWrSTGdcCk2Zy0fCQdJIvkGnzW92hqqjvYLTdjslmnrOVe54bpoAtzcdHg9dcoTC05j8bt1azp98k1P01zAsB0TULfuqhMcSXNzh6C-_uzTO-7MyNHNSCkLhqbWGcsLUb0aHSUi5pzziJw1W1_gx5YajMqdnK-lmwN0HcyWY Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 2b88389a00a342e285e0c31b90368f87 Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:20.064253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:20.065909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2b88389a00a342e285e0c31b90368f87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b88389a00a342e285e0c31b90368f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b88389a00a342e285e0c31b90368f87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2b88389a00a342e285e0c31b90368f87"}]}] Jun 06 13:16:20.065909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:20.065909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 2b88389a00a342e285e0c31b90368f87 Jun 06 13:16:20.065909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:20.065909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeTestJSON-1237312882-project Jun 06 13:16:20.065909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:20.065909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:20.065909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 288ab671062d409f98b91aeacde8b5fc Jun 06 13:16:20.065909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeTestJSON-1237312882-project Jun 06 13:16:20.065909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:20.065909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:20.065909 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '1ff2f700-fdee-4fd2-a53f-92620522ffb2'} Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:20.066814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. Jun 06 13:16:20.068985 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.070606 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-febdd050-14fc-4934-a2a6-f562ddda29c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Returning 404 to user: Instance 1ff2f700-fdee-4fd2-a53f-92620522ffb2 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:20.070606 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-febdd050-14fc-4934-a2a6-f562ddda29c8 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2" status: 404 len: 111 microversion: 2.1 time: 0.029077 Jun 06 13:16:20.070606 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 494/1006] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:20 2022] GET /compute/v2.1/servers/1ff2f700-fdee-4fd2-a53f-92620522ffb2 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 13:16:20.136791 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e5b03927-8c2d-4c9d-8340-c27844cf5ffc tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:20.137402 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e5b03927-8c2d-4c9d-8340-c27844cf5ffc tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:20.143594 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e5b03927-8c2d-4c9d-8340-c27844cf5ffc tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.144047 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e5b03927-8c2d-4c9d-8340-c27844cf5ffc tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.144812 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e5b03927-8c2d-4c9d-8340-c27844cf5ffc tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.145289 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e5b03927-8c2d-4c9d-8340-c27844cf5ffc tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.281492 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e5b03927-8c2d-4c9d-8340-c27844cf5ffc tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:20.289263 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e5b03927-8c2d-4c9d-8340-c27844cf5ffc tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1464 microversion: 2.1 time: 0.156264 Jun 06 13:16:20.289836 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 495/1007] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:20 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1464 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:16:20.331351 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a6902920-6eb2-45df-b298-9f8b2d0ccaa7 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:20.332249 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a6902920-6eb2-45df-b298-9f8b2d0ccaa7 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:20.338758 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a6902920-6eb2-45df-b298-9f8b2d0ccaa7 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.339211 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a6902920-6eb2-45df-b298-9f8b2d0ccaa7 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.340056 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a6902920-6eb2-45df-b298-9f8b2d0ccaa7 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.340493 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a6902920-6eb2-45df-b298-9f8b2d0ccaa7 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.365031 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a6902920-6eb2-45df-b298-9f8b2d0ccaa7 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Going to try to terminate instance {{(pid=118134) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:16:20.494430 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b5a5e98e-203c-42b0-a562-049da2156858 tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] 10.222.0.13 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.770042 Jun 06 13:16:20.494430 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 513/1008] 10.222.0.13 () {60 vars in 1155 bytes} [Mon Jun 6 13:16:19 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 771 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Jun 06 13:16:20.504546 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-db96242a-76cd-440e-9433-d4c6f10ea28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:20.505724 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-db96242a-76cd-440e-9433-d4c6f10ea28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:20.512774 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-db96242a-76cd-440e-9433-d4c6f10ea28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.513217 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-db96242a-76cd-440e-9433-d4c6f10ea28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.513975 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-db96242a-76cd-440e-9433-d4c6f10ea28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.514407 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-db96242a-76cd-440e-9433-d4c6f10ea28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.527907 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-db96242a-76cd-440e-9433-d4c6f10ea28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-db96242a-76cd-440e-9433-d4c6f10ea28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: DELETE /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce HTTP/1.1 Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:16:20.529442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:16:20.531075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:16:20.531075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:20.531075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:20.531075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:20.531075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:20.531075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:16:20.531075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:16:20.531075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:16:20.531075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:20.531075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:16:20.531075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:16:20.531075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': 'ec960d68-c9a5-4886-a3f3-07c63abf3cce'} Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:20.532661 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:16:20.533943 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.535369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-db96242a-76cd-440e-9433-d4c6f10ea28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 404 to user: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:20.535369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-db96242a-76cd-440e-9433-d4c6f10ea28a tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "DELETE /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 404 len: 111 microversion: 2.1 time: 0.030231 Jun 06 13:16:20.535369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 514/1009] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:16:20 2022] DELETE /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 13:16:20.536041 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ddabd040-ee67-4c26-9247-2da2318945dd tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] Calling method '.version_select at 0x7f0efc0b5dc0>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:20.554744 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=98,nova_api:UPDATE=1,nova_api:DELETE=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:20.588629 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ddabd040-ee67-4c26-9247-2da2318945dd tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6300c694-243d-4b53-8a17-2c135d008c1a" status: 200 len: 353 microversion: 2.1 time: 0.056263 Jun 06 13:16:20.589196 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 515/1010] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:16:20 2022] GET /compute/v2.1/os-volumes/6300c694-243d-4b53-8a17-2c135d008c1a => generated 353 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:20.593836 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8c27daad-950e-4322-a9dc-7a70c4637b83 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:20.594431 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8c27daad-950e-4322-a9dc-7a70c4637b83 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] [instance: ec960d68-c9a5-4886-a3f3-07c63abf3cce] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:20.600710 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c27daad-950e-4322-a9dc-7a70c4637b83 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.601151 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c27daad-950e-4322-a9dc-7a70c4637b83 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.601907 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c27daad-950e-4322-a9dc-7a70c4637b83 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.602332 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c27daad-950e-4322-a9dc-7a70c4637b83 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.616247 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-8c27daad-950e-4322-a9dc-7a70c4637b83 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] HTTP exception thrown: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8c27daad-950e-4322-a9dc-7a70c4637b83 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Request method failure captured: Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce HTTP/1.1 Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxXwzJy9XDu1EWniDuNbFos94FhSHqN5Ux8qdBPZMvQibJ3EhUqv4HZeRDQ3N0eJnWfhXoSGpe6VEkVZFIDmH0dAQPpXPbA-UUs_EUoIwdc6Vo95bnBifYsfxcqswMh5W0Yu7slpUwG_LnqX5pp6igh926KLpPFAprtgyUm1Umxsmg Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:16:20.617752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:16:20.619442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_d6db503a0a1749789e92ed63f5a113b7", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/d6db503a0a1749789e92ed63f5a113b7"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/d6db503a0a1749789e92ed63f5a113b7"}]}] Jun 06 13:16:20.619442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:20.619442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: d6db503a0a1749789e92ed63f5a113b7 Jun 06 13:16:20.619442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-1494965285 Jun 06 13:16:20.619442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:20.619442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:16:20.619442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:16:20.619442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 9c620175b84d4cee9aef398864c03c8d Jun 06 13:16:20.619442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeNegativeTest-1494965285-project Jun 06 13:16:20.619442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:16:20.619442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:16:20.619442 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': 'ec960d68-c9a5-4886-a3f3-07c63abf3cce'} Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:20.620653 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. Jun 06 13:16:20.622125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:20.623565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8c27daad-950e-4322-a9dc-7a70c4637b83 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] Returning 404 to user: Instance ec960d68-c9a5-4886-a3f3-07c63abf3cce could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:20.623565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8c27daad-950e-4322-a9dc-7a70c4637b83 tempest-AttachVolumeNegativeTest-1494965285 tempest-AttachVolumeNegativeTest-1494965285-project] 10.222.0.13 "GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce" status: 404 len: 111 microversion: 2.1 time: 0.028994 Jun 06 13:16:20.623565 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 516/1011] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:20 2022] GET /compute/v2.1/servers/ec960d68-c9a5-4886-a3f3-07c63abf3cce => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:20.639897 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a6902920-6eb2-45df-b298-9f8b2d0ccaa7 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "DELETE /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 204 len: 0 microversion: 2.1 time: 0.311969 Jun 06 13:16:20.640512 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 496/1012] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:16:20 2022] DELETE /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 0 bytes in 314 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 13:16:20.648951 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e0ef591c-d82d-45ba-a1af-60eba4ec3469 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:20.664586 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e0ef591c-d82d-45ba-a1af-60eba4ec3469 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:20.664586 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e0ef591c-d82d-45ba-a1af-60eba4ec3469 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.664586 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e0ef591c-d82d-45ba-a1af-60eba4ec3469 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.664586 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e0ef591c-d82d-45ba-a1af-60eba4ec3469 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:20.664962 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e0ef591c-d82d-45ba-a1af-60eba4ec3469 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:20.791452 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e0ef591c-d82d-45ba-a1af-60eba4ec3469 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:20.799413 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e0ef591c-d82d-45ba-a1af-60eba4ec3469 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1470 microversion: 2.1 time: 0.154498 Jun 06 13:16:20.800033 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 517/1013] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:20 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1470 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:21.343755 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cf2dfc17-0410-4c83-a3c2-ae21b8cbf321 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:21.344332 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-cf2dfc17-0410-4c83-a3c2-ae21b8cbf321 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:21.351702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cf2dfc17-0410-4c83-a3c2-ae21b8cbf321 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:21.352144 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cf2dfc17-0410-4c83-a3c2-ae21b8cbf321 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:21.352926 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cf2dfc17-0410-4c83-a3c2-ae21b8cbf321 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:21.353356 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cf2dfc17-0410-4c83-a3c2-ae21b8cbf321 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:21.367229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-cf2dfc17-0410-4c83-a3c2-ae21b8cbf321 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] HTTP exception thrown: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cf2dfc17-0410-4c83-a3c2-ae21b8cbf321 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Request method failure captured: Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: DELETE /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 HTTP/1.1 Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinfxbTNndWrSTGdcCk2Zy0fCQdJIvkGnzW92hqqjvYLTdjslmnrOVe54bpoAtzcdHg9dcoTC05j8bt1azp98k1P01zAsB0TULfuqhMcSXNzh6C-_uzTO-7MyNHNSCkLhqbWGcsLUb0aHSUi5pzziJw1W1_gx5YajMqdnK-lmwN0HcyWY Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 2b88389a00a342e285e0c31b90368f87 Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:21.368979 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:21.370748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2b88389a00a342e285e0c31b90368f87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b88389a00a342e285e0c31b90368f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b88389a00a342e285e0c31b90368f87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2b88389a00a342e285e0c31b90368f87"}]}] Jun 06 13:16:21.370748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:21.370748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 2b88389a00a342e285e0c31b90368f87 Jun 06 13:16:21.370748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:21.370748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-AttachVolumeTestJSON-1237312882-project Jun 06 13:16:21.370748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:21.370748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:21.370748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 288ab671062d409f98b91aeacde8b5fc Jun 06 13:16:21.370748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-AttachVolumeTestJSON-1237312882-project Jun 06 13:16:21.370748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:21.370748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:16:21.370748 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '05c0144f-361b-4c15-813d-6c7b190ff600'} Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:21.371726 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:16:21.373200 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:21.374615 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cf2dfc17-0410-4c83-a3c2-ae21b8cbf321 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Returning 404 to user: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:21.374615 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cf2dfc17-0410-4c83-a3c2-ae21b8cbf321 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "DELETE /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 404 len: 111 microversion: 2.1 time: 0.031082 Jun 06 13:16:21.374615 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 497/1014] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:16:21 2022] DELETE /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 13:16:21.379013 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0f55a19a-68c8-46f7-9999-62912b64ae53 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:21.379736 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0f55a19a-68c8-46f7-9999-62912b64ae53 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] [instance: 05c0144f-361b-4c15-813d-6c7b190ff600] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:21.386875 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0f55a19a-68c8-46f7-9999-62912b64ae53 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:21.392087 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0f55a19a-68c8-46f7-9999-62912b64ae53 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:21.392087 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0f55a19a-68c8-46f7-9999-62912b64ae53 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:21.392087 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0f55a19a-68c8-46f7-9999-62912b64ae53 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:21.402684 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-0f55a19a-68c8-46f7-9999-62912b64ae53 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] HTTP exception thrown: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0f55a19a-68c8-46f7-9999-62912b64ae53 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Request method failure captured: Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 HTTP/1.1 Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinfxbTNndWrSTGdcCk2Zy0fCQdJIvkGnzW92hqqjvYLTdjslmnrOVe54bpoAtzcdHg9dcoTC05j8bt1azp98k1P01zAsB0TULfuqhMcSXNzh6C-_uzTO-7MyNHNSCkLhqbWGcsLUb0aHSUi5pzziJw1W1_gx5YajMqdnK-lmwN0HcyWY Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: 2b88389a00a342e285e0c31b90368f87 Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:16:21.404233 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:16:21.405792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2b88389a00a342e285e0c31b90368f87", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b88389a00a342e285e0c31b90368f87"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2b88389a00a342e285e0c31b90368f87"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2b88389a00a342e285e0c31b90368f87"}]}] Jun 06 13:16:21.405792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:21.405792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 2b88389a00a342e285e0c31b90368f87 Jun 06 13:16:21.405792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1237312882 Jun 06 13:16:21.405792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-AttachVolumeTestJSON-1237312882-project Jun 06 13:16:21.405792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:16:21.405792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:16:21.405792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 288ab671062d409f98b91aeacde8b5fc Jun 06 13:16:21.405792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-AttachVolumeTestJSON-1237312882-project Jun 06 13:16:21.405792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:16:21.405792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:16:21.405792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': '05c0144f-361b-4c15-813d-6c7b190ff600'} Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:21.406715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. Jun 06 13:16:21.408119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:21.409351 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0f55a19a-68c8-46f7-9999-62912b64ae53 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] Returning 404 to user: Instance 05c0144f-361b-4c15-813d-6c7b190ff600 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:21.409351 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0f55a19a-68c8-46f7-9999-62912b64ae53 tempest-AttachVolumeTestJSON-1237312882 tempest-AttachVolumeTestJSON-1237312882-project] 10.222.0.13 "GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600" status: 404 len: 111 microversion: 2.1 time: 0.030645 Jun 06 13:16:21.409351 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 518/1015] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:21 2022] GET /compute/v2.1/servers/05c0144f-361b-4c15-813d-6c7b190ff600 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:21.604873 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a63e536b-06d7-4ce2-8833-78cd50ddc0b4 tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] Calling method '.version_select at 0x7f0efc2e8a60>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:21.654199 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a63e536b-06d7-4ce2-8833-78cd50ddc0b4 tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6300c694-243d-4b53-8a17-2c135d008c1a" status: 200 len: 354 microversion: 2.1 time: 0.054538 Jun 06 13:16:21.655021 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 498/1016] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:16:21 2022] GET /compute/v2.1/os-volumes/6300c694-243d-4b53-8a17-2c135d008c1a => generated 354 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:21.670660 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-88f10bd5-91ee-430e-bbc4-cd2d6eb2e61a tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] Calling method '.version_select at 0x7f0efc0fd040>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:21.746534 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-88f10bd5-91ee-430e-bbc4-cd2d6eb2e61a tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6300c694-243d-4b53-8a17-2c135d008c1a" status: 200 len: 354 microversion: 2.1 time: 0.079973 Jun 06 13:16:21.751556 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 519/1017] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:16:21 2022] GET /compute/v2.1/os-volumes/6300c694-243d-4b53-8a17-2c135d008c1a => generated 354 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:21.762872 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cb34a4bc-8c17-47f2-814a-5afda72919bb tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] Calling method '.version_select at 0x7f0efc2e8c10>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:21.817173 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-db3daa23-01cd-480b-be8a-7b6e8950a508 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:21.818258 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-db3daa23-01cd-480b-be8a-7b6e8950a508 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:21.831023 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-db3daa23-01cd-480b-be8a-7b6e8950a508 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:21.831924 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-db3daa23-01cd-480b-be8a-7b6e8950a508 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:21.833045 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-db3daa23-01cd-480b-be8a-7b6e8950a508 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:21.833745 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-db3daa23-01cd-480b-be8a-7b6e8950a508 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:22.104331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cb34a4bc-8c17-47f2-814a-5afda72919bb tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] 10.222.0.13 "DELETE /compute/v2.1/os-volumes/6300c694-243d-4b53-8a17-2c135d008c1a" status: 202 len: 0 microversion: 2.1 time: 0.344323 Jun 06 13:16:22.104801 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 499/1018] 10.222.0.13 () {58 vars in 1247 bytes} [Mon Jun 6 13:16:21 2022] DELETE /compute/v2.1/os-volumes/6300c694-243d-4b53-8a17-2c135d008c1a => generated 0 bytes in 346 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:16:22.112591 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b215bcb2-0ae9-4de2-bccb-0d4c50b03a2a tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] Calling method '.version_select at 0x7f0efc1acf70>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:22.132896 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-db3daa23-01cd-480b-be8a-7b6e8950a508 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:22.142400 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-db3daa23-01cd-480b-be8a-7b6e8950a508 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1470 microversion: 2.1 time: 0.329725 Jun 06 13:16:22.152845 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 520/1019] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:21 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1470 bytes in 331 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:16:22.181396 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b215bcb2-0ae9-4de2-bccb-0d4c50b03a2a tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6300c694-243d-4b53-8a17-2c135d008c1a" status: 200 len: 353 microversion: 2.1 time: 0.072739 Jun 06 13:16:22.182193 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 500/1020] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:16:22 2022] GET /compute/v2.1/os-volumes/6300c694-243d-4b53-8a17-2c135d008c1a => generated 353 bytes in 74 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:16:23.134226 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-4d547552-1333-40f5-b735-4e2684c5750b req-f5cee44e-a659-4a62-8960-1ac93a815076 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "83546f6a-ff23-4700-b47a-f08f6f3d5b8b", "name": "network-vif-deleted", "tag": "5181d25a-ae47-479e-bdfc-0b79fb8bbece"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:16:23.156284 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-4d547552-1333-40f5-b735-4e2684c5750b req-f5cee44e-a659-4a62-8960-1ac93a815076 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:23.157145 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-4d547552-1333-40f5-b735-4e2684c5750b req-f5cee44e-a659-4a62-8960-1ac93a815076 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:23.161860 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fe1a6da6-8445-4470-acef-dcd2098b1c87 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:23.162552 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-fe1a6da6-8445-4470-acef-dcd2098b1c87 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:23.180987 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe1a6da6-8445-4470-acef-dcd2098b1c87 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:23.181264 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe1a6da6-8445-4470-acef-dcd2098b1c87 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:23.182072 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe1a6da6-8445-4470-acef-dcd2098b1c87 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:23.182509 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fe1a6da6-8445-4470-acef-dcd2098b1c87 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:23.195646 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-4d547552-1333-40f5-b735-4e2684c5750b req-f5cee44e-a659-4a62-8960-1ac93a815076 service nova] Creating event network-vif-deleted:5181d25a-ae47-479e-bdfc-0b79fb8bbece for instance 83546f6a-ff23-4700-b47a-f08f6f3d5b8b on hv-cinder-75510 Jun 06 13:16:23.203628 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-4d547552-1333-40f5-b735-4e2684c5750b req-f5cee44e-a659-4a62-8960-1ac93a815076 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.071775 Jun 06 13:16:23.206974 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 521/1021] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:16:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:23.225715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c29e8dbf-0fc8-4be8-8675-f6b03e5c8e46 tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] Calling method '.version_select at 0x7f0efc18d820>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:23.283815 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-c29e8dbf-0fc8-4be8-8675-f6b03e5c8e46 tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] HTTP exception thrown: Volume 6300c694-243d-4b53-8a17-2c135d008c1a could not be found. Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c29e8dbf-0fc8-4be8-8675-f6b03e5c8e46 tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] Request method failure captured: Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/os-volumes/6300c694-243d-4b53-8a17-2c135d008c1a HTTP/1.1 Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinf4jLELm1kcGnIdrTqAAdhdsz44Ar3kB1zU7OTyY6K5uNQu_8dGDlvu2rT-At4_IZzF86jSu94mvBSYkDONmmO9W7wKBFNoTPFMOVrHNXewQlu17U9ihf26Hze3akkvYx_kL5mMdM2RYL3jDdR05ZSnoL5GA2MttGAd0aQVghBCy2V4 Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: 580a3f003c704fcc9a8fd68365213245 Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-VolumesGetTestJSON-78031172 Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:16:23.286758 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:16:23.288344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_580a3f003c704fcc9a8fd68365213245", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/580a3f003c704fcc9a8fd68365213245"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/580a3f003c704fcc9a8fd68365213245"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/580a3f003c704fcc9a8fd68365213245"}]}] Jun 06 13:16:23.288344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-VolumesGetTestJSON-78031172 Jun 06 13:16:23.288344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 580a3f003c704fcc9a8fd68365213245 Jun 06 13:16:23.288344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-VolumesGetTestJSON-78031172 Jun 06 13:16:23.288344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-VolumesGetTestJSON-78031172-project Jun 06 13:16:23.288344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:16:23.288344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:16:23.288344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 1b16a20fc435446e9eafc93cd242eb81 Jun 06 13:16:23.288344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-VolumesGetTestJSON-78031172-project Jun 06 13:16:23.288344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: Jun 06 13:16:23.288344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Volume 6300c694-243d-4b53-8a17-2c135d008c1a could not be found. Jun 06 13:16:23.288344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': '6300c694-243d-4b53-8a17-2c135d008c1a'} Jun 06 13:16:23.288344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 6300c694-243d-4b53-8a17-2c135d008c1a could not be found. (HTTP 404) (Request-ID: req-d7597f8a-abfd-4737-9edc-9d58280858ad) Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:23.292881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi item = cinderclient( Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Jun 06 13:16:23.294130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 6300c694-243d-4b53-8a17-2c135d008c1a could not be found. Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Jun 06 13:16:23.295343 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 6300c694-243d-4b53-8a17-2c135d008c1a could not be found. Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 6300c694-243d-4b53-8a17-2c135d008c1a could not be found. Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c29e8dbf-0fc8-4be8-8675-f6b03e5c8e46 tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] Returning 404 to user: Volume 6300c694-243d-4b53-8a17-2c135d008c1a could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c29e8dbf-0fc8-4be8-8675-f6b03e5c8e46 tempest-VolumesGetTestJSON-78031172 tempest-VolumesGetTestJSON-78031172-project] 10.222.0.13 "GET /compute/v2.1/os-volumes/6300c694-243d-4b53-8a17-2c135d008c1a" status: 404 len: 109 microversion: 2.1 time: 0.070731 Jun 06 13:16:23.307194 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 522/1022] 10.222.0.13 () {58 vars in 1244 bytes} [Mon Jun 6 13:16:23 2022] GET /compute/v2.1/os-volumes/6300c694-243d-4b53-8a17-2c135d008c1a => generated 109 bytes in 81 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:23.669165 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-fe1a6da6-8445-4470-acef-dcd2098b1c87 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '862defb578e7407f9d6220846a5d369d', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '4d69bf03f62e4bb28481e5f6b4061464', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:23.677887 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-fe1a6da6-8445-4470-acef-dcd2098b1c87 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 200 len: 1428 microversion: 2.1 time: 0.520951 Jun 06 13:16:23.678804 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 501/1023] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:23 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 1428 bytes in 523 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:24.698176 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f13aad15-7c65-4c4b-8721-d2aaa52cadf2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:24.700495 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f13aad15-7c65-4c4b-8721-d2aaa52cadf2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] [instance: 83546f6a-ff23-4700-b47a-f08f6f3d5b8b] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:24.717796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f13aad15-7c65-4c4b-8721-d2aaa52cadf2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:24.717796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f13aad15-7c65-4c4b-8721-d2aaa52cadf2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:24.717796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f13aad15-7c65-4c4b-8721-d2aaa52cadf2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:24.717796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f13aad15-7c65-4c4b-8721-d2aaa52cadf2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:24.748257 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-f13aad15-7c65-4c4b-8721-d2aaa52cadf2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] HTTP exception thrown: Instance 83546f6a-ff23-4700-b47a-f08f6f3d5b8b could not be found. Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f13aad15-7c65-4c4b-8721-d2aaa52cadf2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Request method failure captured: Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b HTTP/1.1 Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinf4LePXr4a7h-ZFEc20X2G1FfW5lVsbXsGItV87Y9CoErC4uZhQek_Ellfq-Vnop2ptWyhlabgmDRE9wbzstY0Ds_pwzB7M-E6Z5s4aprIzg2EhgxwpSn9HTzz0e5N6MlsIri0tgp4ZMu6FTvV0r9nwt_gHcPVlkwrFB3-4JqgJGOGo Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: 4d69bf03f62e4bb28481e5f6b4061464 Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-VolumesNegativeTest-880029176 Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:16:24.752220 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:16:24.753862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_4d69bf03f62e4bb28481e5f6b4061464", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4d69bf03f62e4bb28481e5f6b4061464"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/4d69bf03f62e4bb28481e5f6b4061464"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/4d69bf03f62e4bb28481e5f6b4061464"}]}] Jun 06 13:16:24.753862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-VolumesNegativeTest-880029176 Jun 06 13:16:24.753862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 4d69bf03f62e4bb28481e5f6b4061464 Jun 06 13:16:24.753862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-VolumesNegativeTest-880029176 Jun 06 13:16:24.753862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-VolumesNegativeTest-880029176-project Jun 06 13:16:24.753862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:16:24.753862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:16:24.753862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: 862defb578e7407f9d6220846a5d369d Jun 06 13:16:24.753862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-VolumesNegativeTest-880029176-project Jun 06 13:16:24.753862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:16:24.753862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance 83546f6a-ff23-4700-b47a-f08f6f3d5b8b could not be found. Jun 06 13:16:24.753862 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': '83546f6a-ff23-4700-b47a-f08f6f3d5b8b'} Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 83546f6a-ff23-4700-b47a-f08f6f3d5b8b could not be found. Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:24.755276 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 83546f6a-ff23-4700-b47a-f08f6f3d5b8b could not be found. Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 83546f6a-ff23-4700-b47a-f08f6f3d5b8b could not be found. Jun 06 13:16:24.756984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:16:24.779804 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f13aad15-7c65-4c4b-8721-d2aaa52cadf2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] Returning 404 to user: Instance 83546f6a-ff23-4700-b47a-f08f6f3d5b8b could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:24.779804 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f13aad15-7c65-4c4b-8721-d2aaa52cadf2 tempest-VolumesNegativeTest-880029176 tempest-VolumesNegativeTest-880029176-project] 10.222.0.13 "GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b" status: 404 len: 111 microversion: 2.1 time: 0.082170 Jun 06 13:16:24.779804 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 523/1024] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:24 2022] GET /compute/v2.1/servers/83546f6a-ff23-4700-b47a-f08f6f3d5b8b => generated 111 bytes in 83 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:48.897789 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0db07861-bc2b-49f6-8f2a-fa0a52df5ac0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:48.898391 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0db07861-bc2b-49f6-8f2a-fa0a52df5ac0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:48.902156 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=8,nova_api:UPDATE=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:48.908224 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=67,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:48.925444 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0db07861-bc2b-49f6-8f2a-fa0a52df5ac0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:48.927002 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0db07861-bc2b-49f6-8f2a-fa0a52df5ac0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:48.929376 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0db07861-bc2b-49f6-8f2a-fa0a52df5ac0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:48.930053 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0db07861-bc2b-49f6-8f2a-fa0a52df5ac0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:49.003903 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0db07861-bc2b-49f6-8f2a-fa0a52df5ac0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Going to try to terminate instance {{(pid=118134) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:16:49.260965 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=29,nova_api:DELETE=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:49.262132 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=65 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:16:49.342811 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0db07861-bc2b-49f6-8f2a-fa0a52df5ac0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "DELETE /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 204 len: 0 microversion: 2.1 time: 0.450214 Jun 06 13:16:49.344218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 502/1025] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:16:48 2022] DELETE /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 0 bytes in 453 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:16:49.354619 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-567235f0-7d06-4460-a0bd-9efe6f7a2514 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:49.355577 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-567235f0-7d06-4460-a0bd-9efe6f7a2514 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:49.368679 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-567235f0-7d06-4460-a0bd-9efe6f7a2514 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:49.368799 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-567235f0-7d06-4460-a0bd-9efe6f7a2514 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:49.376799 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-567235f0-7d06-4460-a0bd-9efe6f7a2514 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:49.377499 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-567235f0-7d06-4460-a0bd-9efe6f7a2514 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:49.718226 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3786dbcb-dc51-4138-9ba7-72e93546a898 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Action: 'create', calling method: .version_select at 0x7f0ef6e1bc10>, body: {"keypair": {"name": "tempest-TestShelveInstance-306216519", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBNfzpkPbe/8baDAXz22bDLz5S5FzZDjIzBhmppUpfz8Z3+PqCKGurXfMM/0CneAoB4aYQMHK/KpxKrXcrS0e5YhAFP9QxFCak4r4mahVZbSscxZKPruvtBpQH0LPnDZWMQ=="}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:16:49.718714 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-567235f0-7d06-4460-a0bd-9efe6f7a2514 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:49.730002 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-567235f0-7d06-4460-a0bd-9efe6f7a2514 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1575 microversion: 2.1 time: 0.378410 Jun 06 13:16:49.732011 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 503/1026] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:49 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1575 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:49.735679 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-3786dbcb-dc51-4138-9ba7-72e93546a898 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Getting quotas for project 5a011dc568b04d8a91935a613d951b1c. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:16:49.740828 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-3786dbcb-dc51-4138-9ba7-72e93546a898 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Getting quotas for user eaa2b82129ac4f8796fdd57cad8e0bfb and project 5a011dc568b04d8a91935a613d951b1c. Resources: {'key_pairs'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:16:49.910604 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3786dbcb-dc51-4138-9ba7-72e93546a898 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.664206 Jun 06 13:16:49.911666 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 524/1027] 10.222.0.13 () {60 vars in 1158 bytes} [Mon Jun 6 13:16:49 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 666 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:50.749366 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-42e07499-1871-496b-84a2-976e03d9fb8e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:50.749870 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-42e07499-1871-496b-84a2-976e03d9fb8e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:50.759611 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-42e07499-1871-496b-84a2-976e03d9fb8e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:50.760341 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-42e07499-1871-496b-84a2-976e03d9fb8e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:50.761294 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-42e07499-1871-496b-84a2-976e03d9fb8e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:50.761888 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-42e07499-1871-496b-84a2-976e03d9fb8e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:50.929812 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-42e07499-1871-496b-84a2-976e03d9fb8e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:50.948179 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-42e07499-1871-496b-84a2-976e03d9fb8e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1575 microversion: 2.1 time: 0.203402 Jun 06 13:16:50.958231 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 504/1028] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:50 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1575 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:51.971585 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5236a3e7-3f95-425b-9c0e-f076b9202fbe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:51.972152 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5236a3e7-3f95-425b-9c0e-f076b9202fbe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:51.981165 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5236a3e7-3f95-425b-9c0e-f076b9202fbe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:51.981621 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5236a3e7-3f95-425b-9c0e-f076b9202fbe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:51.983734 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5236a3e7-3f95-425b-9c0e-f076b9202fbe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:51.983734 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5236a3e7-3f95-425b-9c0e-f076b9202fbe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:52.070886 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5236a3e7-3f95-425b-9c0e-f076b9202fbe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:52.100909 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5236a3e7-3f95-425b-9c0e-f076b9202fbe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1509 microversion: 2.1 time: 0.120339 Jun 06 13:16:52.108227 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 525/1029] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:51 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1509 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:52.184927 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-0e524fa0-2ba5-48f9-b2ba-423118ea2463 req-0bb68b6e-63ad-4fdc-a96d-7c7c928da579 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "787b0a77-8cba-4834-98e8-4524ac3e03d7", "name": "network-vif-deleted", "tag": "0bb1b662-7ea0-4f9a-b1f3-e9c46704c25e"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:16:52.204983 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-0e524fa0-2ba5-48f9-b2ba-423118ea2463 req-0bb68b6e-63ad-4fdc-a96d-7c7c928da579 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:52.208262 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-0e524fa0-2ba5-48f9-b2ba-423118ea2463 req-0bb68b6e-63ad-4fdc-a96d-7c7c928da579 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:52.248099 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-0e524fa0-2ba5-48f9-b2ba-423118ea2463 req-0bb68b6e-63ad-4fdc-a96d-7c7c928da579 service nova] Creating event network-vif-deleted:0bb1b662-7ea0-4f9a-b1f3-e9c46704c25e for instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 on hv-cinder-75510 Jun 06 13:16:52.254106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-0e524fa0-2ba5-48f9-b2ba-423118ea2463 req-0bb68b6e-63ad-4fdc-a96d-7c7c928da579 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.074992 Jun 06 13:16:52.256072 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 505/1030] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:16:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 77 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:16:53.116362 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c49c51bf-59b1-4577-8575-2f843566a11a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:53.117871 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c49c51bf-59b1-4577-8575-2f843566a11a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:53.138669 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c49c51bf-59b1-4577-8575-2f843566a11a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:53.140669 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c49c51bf-59b1-4577-8575-2f843566a11a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:53.144267 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c49c51bf-59b1-4577-8575-2f843566a11a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:53.146544 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c49c51bf-59b1-4577-8575-2f843566a11a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:53.244540 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c49c51bf-59b1-4577-8575-2f843566a11a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:53.252772 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c49c51bf-59b1-4577-8575-2f843566a11a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 200 len: 1225 microversion: 2.1 time: 0.141291 Jun 06 13:16:53.253620 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 526/1031] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:53 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 1225 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:54.272195 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c2982868-4a17-4ed5-9f67-9cf5be7e0dfb tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:54.272829 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c2982868-4a17-4ed5-9f67-9cf5be7e0dfb tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:54.279228 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c2982868-4a17-4ed5-9f67-9cf5be7e0dfb tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:54.279720 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c2982868-4a17-4ed5-9f67-9cf5be7e0dfb tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:54.280494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c2982868-4a17-4ed5-9f67-9cf5be7e0dfb tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:54.280931 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c2982868-4a17-4ed5-9f67-9cf5be7e0dfb tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:54.296647 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-c2982868-4a17-4ed5-9f67-9cf5be7e0dfb tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] HTTP exception thrown: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c2982868-4a17-4ed5-9f67-9cf5be7e0dfb tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Request method failure captured: Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 HTTP/1.1 Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinf2MuCZsj-CgS1IjgHzRKLaRb-09GdyOYzcb2-rBEiujh8GyrbydjpigUkAXOCxWJF3i_9kSriSbQc-n2ge8Z7Xa93skgHqi5_t73d74O3toeuSN5vDYc4ZFAKN5ZHI3aurv3zrRGmc0sQVg9tta6C3u4ZzHg5RtzkBBPYHK-21VJ4g Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 332996ee21f54ef3b78907332f5decce Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-TestVolumeBootPattern-810099065 Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:16:54.298494 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:16:54.300296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_332996ee21f54ef3b78907332f5decce", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/332996ee21f54ef3b78907332f5decce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/332996ee21f54ef3b78907332f5decce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/332996ee21f54ef3b78907332f5decce"}]}] Jun 06 13:16:54.300296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-TestVolumeBootPattern-810099065 Jun 06 13:16:54.300296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 332996ee21f54ef3b78907332f5decce Jun 06 13:16:54.300296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-TestVolumeBootPattern-810099065 Jun 06 13:16:54.300296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-TestVolumeBootPattern-810099065-project Jun 06 13:16:54.300296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:16:54.300296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:16:54.300296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: bd78c278513540ecadfc1a0f90b9ab16 Jun 06 13:16:54.300296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-TestVolumeBootPattern-810099065-project Jun 06 13:16:54.300296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:16:54.300296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:16:54.300296 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '787b0a77-8cba-4834-98e8-4524ac3e03d7'} Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:16:54.301820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:16:54.303688 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:16:54.305194 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c2982868-4a17-4ed5-9f67-9cf5be7e0dfb tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Returning 404 to user: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:16:54.305194 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c2982868-4a17-4ed5-9f67-9cf5be7e0dfb tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 404 len: 111 microversion: 2.1 time: 0.033305 Jun 06 13:16:54.305194 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 506/1032] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:54 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:16:54.406507 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-1138721295", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-182726226", "security_groups": [{"name": "tempest-secgroup-smoke-99823546"}], "block_device_mapping_v2": [{"uuid": "6f82f379-35ee-4be9-919c-cebd8eab42e6", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ad4e33a2-2cb6-465f-b54a-3fcb95401137"}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:16:54.655985 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] validate_networks() for [('ad4e33a2-2cb6-465f-b54a-3fcb95401137', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:16:55.384407 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:16:55.385063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:16:55.385584 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:16:55.385969 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:16:55.386379 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:16:55.401223 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:55.403138 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:55.404616 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:55.405865 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:55.430101 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Getting quotas for project 332996ee21f54ef3b78907332f5decce. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:16:55.435368 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Getting quotas for user bd78c278513540ecadfc1a0f90b9ab16 and project 332996ee21f54ef3b78907332f5decce. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:16:55.514054 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:16:55.517347 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='6f82f379-35ee-4be9-919c-cebd8eab42e6',volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:16:55.986297 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-de508c0b-b1cf-4006-bd28-0257ccaa8cf6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.583789 Jun 06 13:16:55.995414 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 527/1033] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:16:54 2022] POST /compute/v2.1/servers => generated 404 bytes in 1594 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:16:56.006544 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ff02ab31-5fc1-4f01-ad6a-7a8f8f1581e6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:56.007152 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ff02ab31-5fc1-4f01-ad6a-7a8f8f1581e6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:56.118307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ff02ab31-5fc1-4f01-ad6a-7a8f8f1581e6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:56.126093 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ff02ab31-5fc1-4f01-ad6a-7a8f8f1581e6 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1094 microversion: 2.1 time: 0.124379 Jun 06 13:16:56.127207 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 507/1034] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:56 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1094 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:57.148155 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cc417b36-8d9e-407d-bf40-6f831c550bb5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:57.148155 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cc417b36-8d9e-407d-bf40-6f831c550bb5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:57.154520 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cc417b36-8d9e-407d-bf40-6f831c550bb5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:57.158049 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cc417b36-8d9e-407d-bf40-6f831c550bb5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:57.158049 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cc417b36-8d9e-407d-bf40-6f831c550bb5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:57.158049 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cc417b36-8d9e-407d-bf40-6f831c550bb5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:57.251447 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cc417b36-8d9e-407d-bf40-6f831c550bb5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:57.261555 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cc417b36-8d9e-407d-bf40-6f831c550bb5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1144 microversion: 2.1 time: 0.121598 Jun 06 13:16:57.272408 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 528/1035] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:57 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1144 bytes in 133 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:58.278263 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-de4b647f-92f8-4324-9b21-b979759ae9e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:58.279581 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-de4b647f-92f8-4324-9b21-b979759ae9e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:58.288450 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-de4b647f-92f8-4324-9b21-b979759ae9e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:58.290055 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-de4b647f-92f8-4324-9b21-b979759ae9e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:58.295877 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-de4b647f-92f8-4324-9b21-b979759ae9e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:58.296667 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-de4b647f-92f8-4324-9b21-b979759ae9e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:58.374192 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-de4b647f-92f8-4324-9b21-b979759ae9e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:58.384041 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-de4b647f-92f8-4324-9b21-b979759ae9e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1200 microversion: 2.1 time: 0.109413 Jun 06 13:16:58.386112 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 508/1036] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:58 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1200 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:16:59.403400 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-00db102a-3f23-4ad6-aff7-cd2ed5f56a04 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:16:59.404125 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-00db102a-3f23-4ad6-aff7-cd2ed5f56a04 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:16:59.418359 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-00db102a-3f23-4ad6-aff7-cd2ed5f56a04 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:59.418812 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-00db102a-3f23-4ad6-aff7-cd2ed5f56a04 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:59.421836 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-00db102a-3f23-4ad6-aff7-cd2ed5f56a04 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:16:59.422347 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-00db102a-3f23-4ad6-aff7-cd2ed5f56a04 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:16:59.772757 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-00db102a-3f23-4ad6-aff7-cd2ed5f56a04 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:16:59.786142 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-00db102a-3f23-4ad6-aff7-cd2ed5f56a04 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1276 microversion: 2.1 time: 0.386067 Jun 06 13:16:59.786738 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 529/1037] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:16:59 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1276 bytes in 388 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:00.625023 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-272de651-4b24-4944-8578-e017fc2675b1 req-1f3c480c-8b09-4929-b79c-05aedcff718d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d88f29a9-f0a6-491c-9b00-a2e5430ad5f5", "tag": "5f84d587-2cc8-4dcb-89d9-9d016ea2cffc"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:00.641681 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-272de651-4b24-4944-8578-e017fc2675b1 req-1f3c480c-8b09-4929-b79c-05aedcff718d service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:00.642329 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-272de651-4b24-4944-8578-e017fc2675b1 req-1f3c480c-8b09-4929-b79c-05aedcff718d service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:00.676983 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-272de651-4b24-4944-8578-e017fc2675b1 req-1f3c480c-8b09-4929-b79c-05aedcff718d service nova] Creating event network-changed:5f84d587-2cc8-4dcb-89d9-9d016ea2cffc for instance d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 on hv-cinder-75510 Jun 06 13:17:00.682564 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-272de651-4b24-4944-8578-e017fc2675b1 req-1f3c480c-8b09-4929-b79c-05aedcff718d service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.065143 Jun 06 13:17:00.684561 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 509/1038] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:17:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:17:00.815711 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c61b4bb8-cfce-4486-899e-5c40489443e1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:00.818230 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c61b4bb8-cfce-4486-899e-5c40489443e1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:00.840511 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c61b4bb8-cfce-4486-899e-5c40489443e1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:00.841130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c61b4bb8-cfce-4486-899e-5c40489443e1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:00.841873 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c61b4bb8-cfce-4486-899e-5c40489443e1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:00.842871 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c61b4bb8-cfce-4486-899e-5c40489443e1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:01.086623 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c61b4bb8-cfce-4486-899e-5c40489443e1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:01.096379 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c61b4bb8-cfce-4486-899e-5c40489443e1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1264 microversion: 2.1 time: 0.288056 Jun 06 13:17:01.097058 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 530/1039] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:00 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1264 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:02.116146 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5820c399-afae-4079-bd41-63335ff75b4b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:02.116821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5820c399-afae-4079-bd41-63335ff75b4b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:02.123474 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5820c399-afae-4079-bd41-63335ff75b4b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:02.123937 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5820c399-afae-4079-bd41-63335ff75b4b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:02.124690 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5820c399-afae-4079-bd41-63335ff75b4b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:02.125115 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5820c399-afae-4079-bd41-63335ff75b4b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:02.262476 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5820c399-afae-4079-bd41-63335ff75b4b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:02.270975 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5820c399-afae-4079-bd41-63335ff75b4b tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1264 microversion: 2.1 time: 0.159979 Jun 06 13:17:02.271812 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 510/1040] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:02 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1264 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:02.880404 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-70291912", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "networks": [{"uuid": "d9842708-303a-498a-a080-8dfa05d3a13f"}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:02.937473 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] validate_networks() for [('d9842708-303a-498a-a080-8dfa05d3a13f', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:17:03.288007 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-62775dd1-9fa2-42af-9fc2-438ccd8e6b3e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:03.288610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-62775dd1-9fa2-42af-9fc2-438ccd8e6b3e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:03.295560 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-62775dd1-9fa2-42af-9fc2-438ccd8e6b3e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:03.296310 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-62775dd1-9fa2-42af-9fc2-438ccd8e6b3e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:03.297825 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-62775dd1-9fa2-42af-9fc2-438ccd8e6b3e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:03.300701 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-62775dd1-9fa2-42af-9fc2-438ccd8e6b3e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:03.326785 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:17:03.327286 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:17:03.327926 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:17:03.328335 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:17:03.328746 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:17:03.338487 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:03.338940 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:03.339799 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:03.340241 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:03.359196 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Getting quotas for project 2dbb7192ee02406a959af9cc4c2577a2. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:17:03.363193 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Getting quotas for user 34e95873c90645b59bd6225c15118847 and project 2dbb7192ee02406a959af9cc4c2577a2. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:17:03.375605 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:17:03.377206 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:17:03.453307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-62775dd1-9fa2-42af-9fc2-438ccd8e6b3e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:03.461610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-62775dd1-9fa2-42af-9fc2-438ccd8e6b3e tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1264 microversion: 2.1 time: 0.177679 Jun 06 13:17:03.462169 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 511/1041] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:03 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1264 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:03.518774 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dbae21b7-e767-41e6-9a22-1386e2fd6fea tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.643551 Jun 06 13:17:03.519549 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 531/1042] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:17:02 2022] POST /compute/v2.1/servers => generated 380 bytes in 645 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Jun 06 13:17:03.530089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f6b91d3e-c4e4-4824-a17e-9bdb47b2f95f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:03.532548 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f6b91d3e-c4e4-4824-a17e-9bdb47b2f95f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:03.591372 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f6b91d3e-c4e4-4824-a17e-9bdb47b2f95f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:03.599326 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f6b91d3e-c4e4-4824-a17e-9bdb47b2f95f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1212 microversion: 2.1 time: 0.073169 Jun 06 13:17:03.600034 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 512/1043] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:03 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1212 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:04.478975 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-85395896-392d-4ef1-8acc-ec6d95696915 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:04.479723 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-85395896-392d-4ef1-8acc-ec6d95696915 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:04.486792 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-85395896-392d-4ef1-8acc-ec6d95696915 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:04.487321 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-85395896-392d-4ef1-8acc-ec6d95696915 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:04.488148 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-85395896-392d-4ef1-8acc-ec6d95696915 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:04.488567 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-85395896-392d-4ef1-8acc-ec6d95696915 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:04.618095 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2ee6c31a-32cd-4c11-b01c-e649f5f704f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:04.618844 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2ee6c31a-32cd-4c11-b01c-e649f5f704f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:04.626755 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2ee6c31a-32cd-4c11-b01c-e649f5f704f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:04.627209 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2ee6c31a-32cd-4c11-b01c-e649f5f704f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:04.628078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2ee6c31a-32cd-4c11-b01c-e649f5f704f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:04.628511 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2ee6c31a-32cd-4c11-b01c-e649f5f704f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:04.633238 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-85395896-392d-4ef1-8acc-ec6d95696915 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:04.640918 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-85395896-392d-4ef1-8acc-ec6d95696915 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1264 microversion: 2.1 time: 0.166541 Jun 06 13:17:04.641482 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 532/1044] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:04 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1264 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:04.714884 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-2ee6c31a-32cd-4c11-b01c-e649f5f704f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:04.724446 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2ee6c31a-32cd-4c11-b01c-e649f5f704f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1216 microversion: 2.1 time: 0.111204 Jun 06 13:17:04.725383 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 513/1045] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:04 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1216 bytes in 113 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:05.659470 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-69c9a542-2c74-4dd0-aec9-1c0b356cdca1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:05.660357 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-69c9a542-2c74-4dd0-aec9-1c0b356cdca1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:05.669005 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-69c9a542-2c74-4dd0-aec9-1c0b356cdca1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:05.669449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-69c9a542-2c74-4dd0-aec9-1c0b356cdca1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:05.670215 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-69c9a542-2c74-4dd0-aec9-1c0b356cdca1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:05.670647 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-69c9a542-2c74-4dd0-aec9-1c0b356cdca1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:05.748294 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-23f3f76e-e2b6-4c15-9c64-009e4ce61a50 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:05.748931 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-23f3f76e-e2b6-4c15-9c64-009e4ce61a50 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:05.760560 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-23f3f76e-e2b6-4c15-9c64-009e4ce61a50 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:05.763409 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-23f3f76e-e2b6-4c15-9c64-009e4ce61a50 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:05.767223 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-23f3f76e-e2b6-4c15-9c64-009e4ce61a50 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:05.767932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-23f3f76e-e2b6-4c15-9c64-009e4ce61a50 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:05.855425 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-69c9a542-2c74-4dd0-aec9-1c0b356cdca1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:05.863984 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-69c9a542-2c74-4dd0-aec9-1c0b356cdca1 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1264 microversion: 2.1 time: 0.209544 Jun 06 13:17:05.867156 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 533/1046] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:05 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1264 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:05.874945 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-23f3f76e-e2b6-4c15-9c64-009e4ce61a50 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:05.884053 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-23f3f76e-e2b6-4c15-9c64-009e4ce61a50 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1272 microversion: 2.1 time: 0.142815 Jun 06 13:17:05.884618 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 514/1047] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:05 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1272 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:06.882183 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-80b11e40-9efa-4395-be00-ddde0b08fc07 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:06.882787 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-80b11e40-9efa-4395-be00-ddde0b08fc07 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:06.892207 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-80b11e40-9efa-4395-be00-ddde0b08fc07 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:06.892662 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-80b11e40-9efa-4395-be00-ddde0b08fc07 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:06.893428 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-80b11e40-9efa-4395-be00-ddde0b08fc07 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:06.894127 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-80b11e40-9efa-4395-be00-ddde0b08fc07 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:06.902612 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9295f3bf-1976-484b-b10d-c055789c953e tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:06.903521 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9295f3bf-1976-484b-b10d-c055789c953e tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:06.915770 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9295f3bf-1976-484b-b10d-c055789c953e tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:06.918846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9295f3bf-1976-484b-b10d-c055789c953e tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:06.919884 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9295f3bf-1976-484b-b10d-c055789c953e tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:06.920497 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9295f3bf-1976-484b-b10d-c055789c953e tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:07.159788 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-80b11e40-9efa-4395-be00-ddde0b08fc07 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:07.164058 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9295f3bf-1976-484b-b10d-c055789c953e tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:07.167407 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-80b11e40-9efa-4395-be00-ddde0b08fc07 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1264 microversion: 2.1 time: 0.289831 Jun 06 13:17:07.168013 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 534/1048] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:06 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1264 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:07.171759 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9295f3bf-1976-484b-b10d-c055789c953e tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1312 microversion: 2.1 time: 0.273603 Jun 06 13:17:07.172307 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 515/1049] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:06 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1312 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:07.608436 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-27c7af28-04a3-469e-9214-0485aae6f96b req-94df7eec-90b7-4cf8-819b-2c02838e5f38 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "4279db04-3475-4b52-aa10-399e70fd89a3", "tag": "138c85f5-e057-4800-bf79-d55d3dc4f307"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:07.617782 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-27c7af28-04a3-469e-9214-0485aae6f96b req-94df7eec-90b7-4cf8-819b-2c02838e5f38 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:07.618311 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-27c7af28-04a3-469e-9214-0485aae6f96b req-94df7eec-90b7-4cf8-819b-2c02838e5f38 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:07.629577 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-27c7af28-04a3-469e-9214-0485aae6f96b req-94df7eec-90b7-4cf8-819b-2c02838e5f38 service nova] Creating event network-changed:138c85f5-e057-4800-bf79-d55d3dc4f307 for instance 4279db04-3475-4b52-aa10-399e70fd89a3 on hv-cinder-75510 Jun 06 13:17:07.635400 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-27c7af28-04a3-469e-9214-0485aae6f96b req-94df7eec-90b7-4cf8-819b-2c02838e5f38 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030618 Jun 06 13:17:07.636044 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 535/1050] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:17:07 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:17:08.185714 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-17cc6ff4-e299-4fce-a605-376cadc4c532 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:08.186647 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-17cc6ff4-e299-4fce-a605-376cadc4c532 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:08.195259 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-17cc6ff4-e299-4fce-a605-376cadc4c532 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:08.196145 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-17cc6ff4-e299-4fce-a605-376cadc4c532 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:08.196603 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-17cc6ff4-e299-4fce-a605-376cadc4c532 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:08.197036 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-17cc6ff4-e299-4fce-a605-376cadc4c532 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:08.197979 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-51e97f0f-5949-49b6-916e-6ca587243805 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:08.198441 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-51e97f0f-5949-49b6-916e-6ca587243805 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:08.204996 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-51e97f0f-5949-49b6-916e-6ca587243805 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:08.205523 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-51e97f0f-5949-49b6-916e-6ca587243805 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:08.206377 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-51e97f0f-5949-49b6-916e-6ca587243805 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:08.206881 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-51e97f0f-5949-49b6-916e-6ca587243805 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:08.424250 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-17cc6ff4-e299-4fce-a605-376cadc4c532 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:08.436506 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-51e97f0f-5949-49b6-916e-6ca587243805 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:08.438700 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-17cc6ff4-e299-4fce-a605-376cadc4c532 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1264 microversion: 2.1 time: 0.257717 Jun 06 13:17:08.439712 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 516/1051] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:08 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1264 bytes in 260 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:08.447749 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-51e97f0f-5949-49b6-916e-6ca587243805 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1312 microversion: 2.1 time: 0.255983 Jun 06 13:17:08.450142 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 536/1052] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:08 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1312 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:09.455277 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f16c162e-1352-481d-a765-719e860fdecc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:09.455956 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f16c162e-1352-481d-a765-719e860fdecc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:09.462572 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f16c162e-1352-481d-a765-719e860fdecc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:09.463016 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f16c162e-1352-481d-a765-719e860fdecc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:09.464132 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f16c162e-1352-481d-a765-719e860fdecc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:09.464299 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f16c162e-1352-481d-a765-719e860fdecc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:09.467797 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-1d7a0f0f-a298-4960-95a1-8ab36baaaadd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:09.468492 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-1d7a0f0f-a298-4960-95a1-8ab36baaaadd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:09.475451 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d7a0f0f-a298-4960-95a1-8ab36baaaadd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:09.476185 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d7a0f0f-a298-4960-95a1-8ab36baaaadd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:09.476949 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d7a0f0f-a298-4960-95a1-8ab36baaaadd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:09.477375 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-1d7a0f0f-a298-4960-95a1-8ab36baaaadd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:09.690887 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f16c162e-1352-481d-a765-719e860fdecc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:09.697970 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-1d7a0f0f-a298-4960-95a1-8ab36baaaadd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:09.698610 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f16c162e-1352-481d-a765-719e860fdecc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1264 microversion: 2.1 time: 0.247170 Jun 06 13:17:09.699188 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 517/1053] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:09 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1264 bytes in 248 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:09.705853 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-1d7a0f0f-a298-4960-95a1-8ab36baaaadd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1312 microversion: 2.1 time: 0.242073 Jun 06 13:17:09.706481 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 537/1054] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:09 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1312 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:10.715172 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-67f9702a-2b46-4568-8c2f-94d4bb80054d tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:10.715814 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-67f9702a-2b46-4568-8c2f-94d4bb80054d tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:10.722418 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67f9702a-2b46-4568-8c2f-94d4bb80054d tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:10.722869 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67f9702a-2b46-4568-8c2f-94d4bb80054d tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:10.723344 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ff47500e-0741-4f79-9779-5470efe96852 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:10.723786 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67f9702a-2b46-4568-8c2f-94d4bb80054d tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:10.723981 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ff47500e-0741-4f79-9779-5470efe96852 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:10.724147 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-67f9702a-2b46-4568-8c2f-94d4bb80054d tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:10.730471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ff47500e-0741-4f79-9779-5470efe96852 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:10.730921 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ff47500e-0741-4f79-9779-5470efe96852 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:10.731714 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ff47500e-0741-4f79-9779-5470efe96852 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:10.732150 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ff47500e-0741-4f79-9779-5470efe96852 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:10.935171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-67f9702a-2b46-4568-8c2f-94d4bb80054d tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:10.939355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ff47500e-0741-4f79-9779-5470efe96852 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:10.943423 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-67f9702a-2b46-4568-8c2f-94d4bb80054d tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1264 microversion: 2.1 time: 0.231456 Jun 06 13:17:10.944129 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 518/1055] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:10 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1264 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:10.948079 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ff47500e-0741-4f79-9779-5470efe96852 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1312 microversion: 2.1 time: 0.228459 Jun 06 13:17:10.948731 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 538/1056] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:10 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1312 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:11.961404 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6e5e6fd0-443f-413f-afff-64323d97f42a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:11.962014 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6e5e6fd0-443f-413f-afff-64323d97f42a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:11.965396 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-539f5241-92d3-40d0-b5e4-78fba7f75b98 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:11.966002 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-539f5241-92d3-40d0-b5e4-78fba7f75b98 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:11.968929 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6e5e6fd0-443f-413f-afff-64323d97f42a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:11.969382 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6e5e6fd0-443f-413f-afff-64323d97f42a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:11.973654 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6e5e6fd0-443f-413f-afff-64323d97f42a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:11.973654 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6e5e6fd0-443f-413f-afff-64323d97f42a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:11.973930 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-539f5241-92d3-40d0-b5e4-78fba7f75b98 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:11.973930 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-539f5241-92d3-40d0-b5e4-78fba7f75b98 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:11.973930 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-539f5241-92d3-40d0-b5e4-78fba7f75b98 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:11.974422 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-539f5241-92d3-40d0-b5e4-78fba7f75b98 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:12.180224 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6e5e6fd0-443f-413f-afff-64323d97f42a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:12.186346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-539f5241-92d3-40d0-b5e4-78fba7f75b98 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:12.187873 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6e5e6fd0-443f-413f-afff-64323d97f42a tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1264 microversion: 2.1 time: 0.231026 Jun 06 13:17:12.188437 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 519/1057] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:11 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1264 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:12.191647 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-539f5241-92d3-40d0-b5e4-78fba7f75b98 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1312 microversion: 2.1 time: 0.230187 Jun 06 13:17:12.192360 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 539/1058] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:11 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1312 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:13.206442 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3bdaae1d-88ff-48c3-8a77-391f7697effd tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:13.207204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3bdaae1d-88ff-48c3-8a77-391f7697effd tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:13.210251 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6a2cddef-b9a6-4a13-b4cb-0388ec66f5f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:13.210872 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6a2cddef-b9a6-4a13-b4cb-0388ec66f5f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:13.215928 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3bdaae1d-88ff-48c3-8a77-391f7697effd tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:13.216471 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3bdaae1d-88ff-48c3-8a77-391f7697effd tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:13.217258 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3bdaae1d-88ff-48c3-8a77-391f7697effd tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:13.217693 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3bdaae1d-88ff-48c3-8a77-391f7697effd tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:13.217901 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6a2cddef-b9a6-4a13-b4cb-0388ec66f5f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:13.218361 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6a2cddef-b9a6-4a13-b4cb-0388ec66f5f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:13.219130 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6a2cddef-b9a6-4a13-b4cb-0388ec66f5f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:13.219595 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6a2cddef-b9a6-4a13-b4cb-0388ec66f5f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:13.353459 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=4 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:13.370481 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=16 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:13.426436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3bdaae1d-88ff-48c3-8a77-391f7697effd tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:13.430455 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:13.434333 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6a2cddef-b9a6-4a13-b4cb-0388ec66f5f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:13.435828 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3bdaae1d-88ff-48c3-8a77-391f7697effd tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1264 microversion: 2.1 time: 0.233468 Jun 06 13:17:13.446028 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6a2cddef-b9a6-4a13-b4cb-0388ec66f5f6 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1312 microversion: 2.1 time: 0.237657 Jun 06 13:17:13.446028 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 540/1059] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:13 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1312 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:13.446474 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 520/1060] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:13 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1264 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:13.448888 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-bf6c14a4-dff6-425d-9f06-9456f498a04b req-9a257712-68ee-46ee-818a-d635947dd561 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88f29a9-f0a6-491c-9b00-a2e5430ad5f5", "name": "network-vif-plugged", "status": "completed", "tag": "5f84d587-2cc8-4dcb-89d9-9d016ea2cffc"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:13.457067 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-bf6c14a4-dff6-425d-9f06-9456f498a04b req-9a257712-68ee-46ee-818a-d635947dd561 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:13.457510 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-bf6c14a4-dff6-425d-9f06-9456f498a04b req-9a257712-68ee-46ee-818a-d635947dd561 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:13.469854 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-bf6c14a4-dff6-425d-9f06-9456f498a04b req-9a257712-68ee-46ee-818a-d635947dd561 service nova] Creating event network-vif-plugged:5f84d587-2cc8-4dcb-89d9-9d016ea2cffc for instance d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 on hv-cinder-75510 Jun 06 13:17:13.474906 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-bf6c14a4-dff6-425d-9f06-9456f498a04b req-9a257712-68ee-46ee-818a-d635947dd561 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029534 Jun 06 13:17:13.475607 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 541/1061] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:17:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:17:14.361142 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-64353289", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-306216519", "security_groups": [{"name": "tempest-secgroup-smoke-1567437798"}], "networks": [{"uuid": "f8873987-c0aa-4618-9c18-d4281e62353d"}], "block_device_mapping_v2": [{"uuid": "291c1f7a-3d90-47ef-91b1-e4da86410dfb", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:14.370212 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=4 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:14.455067 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a4bd8236-6adc-41c3-a128-7a793aca4921 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:14.455636 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a4bd8236-6adc-41c3-a128-7a793aca4921 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:14.462680 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4bd8236-6adc-41c3-a128-7a793aca4921 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:14.463245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4bd8236-6adc-41c3-a128-7a793aca4921 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:14.464109 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4bd8236-6adc-41c3-a128-7a793aca4921 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:14.464611 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a4bd8236-6adc-41c3-a128-7a793aca4921 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:14.488641 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.network.neutron [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] validate_networks() for [('f8873987-c0aa-4618-9c18-d4281e62353d', None, None, None, None, None)] {{(pid=118134) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:17:14.698007 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a4bd8236-6adc-41c3-a128-7a793aca4921 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:14.705673 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a4bd8236-6adc-41c3-a128-7a793aca4921 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1264 microversion: 2.1 time: 0.255905 Jun 06 13:17:14.706491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 542/1062] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:14 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1264 bytes in 258 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:14.711791 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5d184ac7-3318-414a-9c35-47521568c738 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:14.712625 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5d184ac7-3318-414a-9c35-47521568c738 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:14.718874 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5d184ac7-3318-414a-9c35-47521568c738 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:14.719322 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5d184ac7-3318-414a-9c35-47521568c738 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:14.720131 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5d184ac7-3318-414a-9c35-47521568c738 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:14.720554 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5d184ac7-3318-414a-9c35-47521568c738 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:14.930369 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5d184ac7-3318-414a-9c35-47521568c738 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:14.938459 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5d184ac7-3318-414a-9c35-47521568c738 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1312 microversion: 2.1 time: 0.230816 Jun 06 13:17:14.939022 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 543/1063] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:14 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1312 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:15.015815 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Flavor limits 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:17:15.016233 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Image limits 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:17:15.016698 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Flavor pref 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:17:15.017102 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Image pref 0:0:0 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:17:15.017540 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.virt.hardware [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118134) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:17:15.026660 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:15.027101 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:15.027933 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:15.028420 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:15.045472 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Getting quotas for project 5a011dc568b04d8a91935a613d951b1c. Resources: {'cores', 'ram', 'instances'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:17:15.049691 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.quota [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Getting quotas for user eaa2b82129ac4f8796fdd57cad8e0bfb and project 5a011dc568b04d8a91935a613d951b1c. Resources: {'cores', 'ram', 'instances'} {{(pid=118134) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:17:15.107195 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Going to run 1 instances... {{(pid=118134) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:17:15.110155 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='291c1f7a-3d90-47ef-91b1-e4da86410dfb',volume_size=None,volume_type=None)] {{(pid=118134) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:17:15.573942 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f58a817f-840f-455b-a75d-998f000fc98f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.216944 Jun 06 13:17:15.580353 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 521/1064] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:17:14 2022] POST /compute/v2.1/servers => generated 406 bytes in 1224 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:17:15.586576 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-96c4c862-e577-4539-a382-1cadda0715d1 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:15.587193 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-96c4c862-e577-4539-a382-1cadda0715d1 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:15.670952 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-96c4c862-e577-4539-a382-1cadda0715d1 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:15.679115 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-96c4c862-e577-4539-a382-1cadda0715d1 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1086 microversion: 2.1 time: 0.097201 Jun 06 13:17:15.680778 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 544/1065] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:15 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1086 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:15.723046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-52b00c7d-9528-42ed-8d89-d326eb681811 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:15.723679 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-52b00c7d-9528-42ed-8d89-d326eb681811 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:15.730721 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-82114d83-8fdd-4801-8260-0f36754ca7e3 req-87909c1b-502c-42c5-bfcd-d43332fea54e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4279db04-3475-4b52-aa10-399e70fd89a3", "name": "network-vif-plugged", "status": "completed", "tag": "138c85f5-e057-4800-bf79-d55d3dc4f307"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:15.738188 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-52b00c7d-9528-42ed-8d89-d326eb681811 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:15.738188 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-52b00c7d-9528-42ed-8d89-d326eb681811 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:15.738188 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-52b00c7d-9528-42ed-8d89-d326eb681811 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:15.738661 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-52b00c7d-9528-42ed-8d89-d326eb681811 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:15.741027 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-82114d83-8fdd-4801-8260-0f36754ca7e3 req-87909c1b-502c-42c5-bfcd-d43332fea54e service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:15.742281 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-82114d83-8fdd-4801-8260-0f36754ca7e3 req-87909c1b-502c-42c5-bfcd-d43332fea54e service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:15.746623 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=100 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:15.753722 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-82114d83-8fdd-4801-8260-0f36754ca7e3 req-87909c1b-502c-42c5-bfcd-d43332fea54e service nova] Creating event network-vif-plugged:138c85f5-e057-4800-bf79-d55d3dc4f307 for instance 4279db04-3475-4b52-aa10-399e70fd89a3 on hv-cinder-75510 Jun 06 13:17:15.760207 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-82114d83-8fdd-4801-8260-0f36754ca7e3 req-87909c1b-502c-42c5-bfcd-d43332fea54e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033806 Jun 06 13:17:15.763211 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 545/1066] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:17:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:17:15.877843 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-52b00c7d-9528-42ed-8d89-d326eb681811 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:15.886382 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-52b00c7d-9528-42ed-8d89-d326eb681811 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1450 microversion: 2.1 time: 0.166974 Jun 06 13:17:15.886949 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 522/1067] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:15 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1450 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:15.903234 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-250030ea-f77a-4a73-aabc-0e705ba5e08f tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:15.904144 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-250030ea-f77a-4a73-aabc-0e705ba5e08f tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:15.912333 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-250030ea-f77a-4a73-aabc-0e705ba5e08f tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:15.912995 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-250030ea-f77a-4a73-aabc-0e705ba5e08f tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:15.913967 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-250030ea-f77a-4a73-aabc-0e705ba5e08f tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:15.914583 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-250030ea-f77a-4a73-aabc-0e705ba5e08f tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:15.955356 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fbce0cb5-197a-40ce-8e01-b970f38b3d8c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:15.956062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-fbce0cb5-197a-40ce-8e01-b970f38b3d8c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:15.962253 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fbce0cb5-197a-40ce-8e01-b970f38b3d8c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:15.962696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fbce0cb5-197a-40ce-8e01-b970f38b3d8c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:15.963493 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fbce0cb5-197a-40ce-8e01-b970f38b3d8c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:15.963962 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fbce0cb5-197a-40ce-8e01-b970f38b3d8c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:16.115428 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-250030ea-f77a-4a73-aabc-0e705ba5e08f tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:16.127557 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-250030ea-f77a-4a73-aabc-0e705ba5e08f tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1450 microversion: 2.1 time: 0.228589 Jun 06 13:17:16.128909 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 546/1068] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:15 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1450 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:16.149640 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-fbce0cb5-197a-40ce-8e01-b970f38b3d8c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:16.155965 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-fbce0cb5-197a-40ce-8e01-b970f38b3d8c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1312 microversion: 2.1 time: 0.204394 Jun 06 13:17:16.166678 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 523/1069] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:15 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1312 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:16.697456 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-674e35a0-c9e3-4c0b-bbb5-fc2ac4cb9c32 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:16.699272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-674e35a0-c9e3-4c0b-bbb5-fc2ac4cb9c32 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:16.706172 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-674e35a0-c9e3-4c0b-bbb5-fc2ac4cb9c32 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:16.706747 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-674e35a0-c9e3-4c0b-bbb5-fc2ac4cb9c32 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:16.707662 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-674e35a0-c9e3-4c0b-bbb5-fc2ac4cb9c32 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:16.708174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-674e35a0-c9e3-4c0b-bbb5-fc2ac4cb9c32 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:16.817828 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-674e35a0-c9e3-4c0b-bbb5-fc2ac4cb9c32 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:16.826075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-674e35a0-c9e3-4c0b-bbb5-fc2ac4cb9c32 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1136 microversion: 2.1 time: 0.132637 Jun 06 13:17:16.826649 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 547/1070] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:16 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1136 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:17.174319 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2b08d874-2800-40c3-940f-b273ef937407 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:17.178975 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2b08d874-2800-40c3-940f-b273ef937407 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:17.182805 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b08d874-2800-40c3-940f-b273ef937407 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:17.183277 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b08d874-2800-40c3-940f-b273ef937407 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:17.184204 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b08d874-2800-40c3-940f-b273ef937407 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:17.184734 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2b08d874-2800-40c3-940f-b273ef937407 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:17.394684 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-2b08d874-2800-40c3-940f-b273ef937407 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:17.405199 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2b08d874-2800-40c3-940f-b273ef937407 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1312 microversion: 2.1 time: 0.236053 Jun 06 13:17:17.405873 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 524/1071] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:17 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1312 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:17.842382 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-7247c9f8-af8c-4e89-a9e2-61ca4ae9f6e8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:17.843082 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-7247c9f8-af8c-4e89-a9e2-61ca4ae9f6e8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:17.849693 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7247c9f8-af8c-4e89-a9e2-61ca4ae9f6e8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:17.850140 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7247c9f8-af8c-4e89-a9e2-61ca4ae9f6e8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:17.851059 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7247c9f8-af8c-4e89-a9e2-61ca4ae9f6e8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:17.851782 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-7247c9f8-af8c-4e89-a9e2-61ca4ae9f6e8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:17.946502 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-7247c9f8-af8c-4e89-a9e2-61ca4ae9f6e8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:17.957736 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-7247c9f8-af8c-4e89-a9e2-61ca4ae9f6e8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1184 microversion: 2.1 time: 0.119142 Jun 06 13:17:17.958352 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 548/1072] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:17 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1184 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:18.428195 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-741b3fa3-04f9-4451-bcf6-338a548ab7fd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:18.430350 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-741b3fa3-04f9-4451-bcf6-338a548ab7fd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:18.443050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-741b3fa3-04f9-4451-bcf6-338a548ab7fd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:18.443819 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-741b3fa3-04f9-4451-bcf6-338a548ab7fd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:18.446254 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-741b3fa3-04f9-4451-bcf6-338a548ab7fd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:18.446703 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-741b3fa3-04f9-4451-bcf6-338a548ab7fd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:18.653144 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-741b3fa3-04f9-4451-bcf6-338a548ab7fd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:18.661820 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-741b3fa3-04f9-4451-bcf6-338a548ab7fd tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1496 microversion: 2.1 time: 0.238405 Jun 06 13:17:18.677421 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 525/1073] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:18 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1496 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:18.696461 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-357cfb7a-c265-4f13-b2c0-ef8786af262b req-8e97caaf-1544-49c1-9331-1c38e7e6be2e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d88f29a9-f0a6-491c-9b00-a2e5430ad5f5", "tag": "5f84d587-2cc8-4dcb-89d9-9d016ea2cffc"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:18.704601 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-357cfb7a-c265-4f13-b2c0-ef8786af262b req-8e97caaf-1544-49c1-9331-1c38e7e6be2e service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:18.705122 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-357cfb7a-c265-4f13-b2c0-ef8786af262b req-8e97caaf-1544-49c1-9331-1c38e7e6be2e service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:18.717004 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-357cfb7a-c265-4f13-b2c0-ef8786af262b req-8e97caaf-1544-49c1-9331-1c38e7e6be2e service nova] Creating event network-changed:5f84d587-2cc8-4dcb-89d9-9d016ea2cffc for instance d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 on hv-cinder-75510 Jun 06 13:17:18.721998 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-357cfb7a-c265-4f13-b2c0-ef8786af262b req-8e97caaf-1544-49c1-9331-1c38e7e6be2e service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029617 Jun 06 13:17:18.722605 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 549/1074] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:17:18 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:17:18.979089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b8dd4321-1f25-4b97-90eb-73cab9d1d698 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:18.979977 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b8dd4321-1f25-4b97-90eb-73cab9d1d698 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:18.987075 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b8dd4321-1f25-4b97-90eb-73cab9d1d698 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:18.987674 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b8dd4321-1f25-4b97-90eb-73cab9d1d698 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:18.988711 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b8dd4321-1f25-4b97-90eb-73cab9d1d698 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:18.989199 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b8dd4321-1f25-4b97-90eb-73cab9d1d698 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:19.060522 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-b8dd4321-1f25-4b97-90eb-73cab9d1d698 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:19.068776 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b8dd4321-1f25-4b97-90eb-73cab9d1d698 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1202 microversion: 2.1 time: 0.094387 Jun 06 13:17:19.072660 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 526/1075] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:18 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1202 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:19.531570 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-821f8128-eb38-47b9-ade2-28a24b84aac7 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:19.532121 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-821f8128-eb38-47b9-ade2-28a24b84aac7 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:19.545088 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-821f8128-eb38-47b9-ade2-28a24b84aac7 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:19.546047 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-821f8128-eb38-47b9-ade2-28a24b84aac7 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:19.547016 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-821f8128-eb38-47b9-ade2-28a24b84aac7 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:19.547647 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-821f8128-eb38-47b9-ade2-28a24b84aac7 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:19.589498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-821f8128-eb38-47b9-ade2-28a24b84aac7 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:17:19.854002 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=93,nova_api:INSERT=7 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:19.923033 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-821f8128-eb38-47b9-ade2-28a24b84aac7 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "DELETE /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 204 len: 0 microversion: 2.1 time: 0.395363 Jun 06 13:17:19.923927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 550/1076] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:17:19 2022] DELETE /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 0 bytes in 397 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:17:19.933295 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-f6bd51b3-96c6-4d80-8d8b-0ea01ad66f74 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:19.935030 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-f6bd51b3-96c6-4d80-8d8b-0ea01ad66f74 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:19.942678 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f6bd51b3-96c6-4d80-8d8b-0ea01ad66f74 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:19.943094 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f6bd51b3-96c6-4d80-8d8b-0ea01ad66f74 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:19.943904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f6bd51b3-96c6-4d80-8d8b-0ea01ad66f74 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:19.945270 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-f6bd51b3-96c6-4d80-8d8b-0ea01ad66f74 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:20.089033 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-285f6c2b-3860-49e3-88b2-3d4a6abe6afa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:20.089033 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-285f6c2b-3860-49e3-88b2-3d4a6abe6afa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:20.092690 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-f6bd51b3-96c6-4d80-8d8b-0ea01ad66f74 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:20.099249 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-285f6c2b-3860-49e3-88b2-3d4a6abe6afa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:20.100234 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-285f6c2b-3860-49e3-88b2-3d4a6abe6afa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:20.101525 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-f6bd51b3-96c6-4d80-8d8b-0ea01ad66f74 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1502 microversion: 2.1 time: 0.173277 Jun 06 13:17:20.102256 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 527/1077] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:19 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1502 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:20.102622 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-285f6c2b-3860-49e3-88b2-3d4a6abe6afa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:20.103141 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-285f6c2b-3860-49e3-88b2-3d4a6abe6afa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:20.241842 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-285f6c2b-3860-49e3-88b2-3d4a6abe6afa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:20.250051 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-285f6c2b-3860-49e3-88b2-3d4a6abe6afa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1258 microversion: 2.1 time: 0.168186 Jun 06 13:17:20.250634 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 551/1078] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:20 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1258 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:20.665939 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-3e5514a0-0be4-405a-b584-6d0504ee9d5e req-9dc730c7-8e84-472c-9d3d-7483390c205a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c46a57-7fc5-427b-a56d-aa697322d8a8", "tag": "67b1981d-c58b-487a-92c4-bb105c0f52c3"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:20.674964 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-3e5514a0-0be4-405a-b584-6d0504ee9d5e req-9dc730c7-8e84-472c-9d3d-7483390c205a service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:20.675430 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-3e5514a0-0be4-405a-b584-6d0504ee9d5e req-9dc730c7-8e84-472c-9d3d-7483390c205a service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:20.687599 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-3e5514a0-0be4-405a-b584-6d0504ee9d5e req-9dc730c7-8e84-472c-9d3d-7483390c205a service nova] Creating event network-changed:67b1981d-c58b-487a-92c4-bb105c0f52c3 for instance 25c46a57-7fc5-427b-a56d-aa697322d8a8 on hv-cinder-75510 Jun 06 13:17:20.694029 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-3e5514a0-0be4-405a-b584-6d0504ee9d5e req-9dc730c7-8e84-472c-9d3d-7483390c205a service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035685 Jun 06 13:17:20.695225 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 528/1079] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:17:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:17:21.119935 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3a31135e-884c-4f2c-beee-9a26d92b2fcf tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:21.121307 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3a31135e-884c-4f2c-beee-9a26d92b2fcf tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:21.127979 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a31135e-884c-4f2c-beee-9a26d92b2fcf tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:21.128425 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a31135e-884c-4f2c-beee-9a26d92b2fcf tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:21.129191 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a31135e-884c-4f2c-beee-9a26d92b2fcf tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:21.129623 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3a31135e-884c-4f2c-beee-9a26d92b2fcf tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:21.265357 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3a31135e-884c-4f2c-beee-9a26d92b2fcf tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:21.269168 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-51cc8dc0-6aa5-4a55-a39c-61a26a6c27c8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:21.270189 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-51cc8dc0-6aa5-4a55-a39c-61a26a6c27c8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:21.273951 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:21.279693 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3a31135e-884c-4f2c-beee-9a26d92b2fcf tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1502 microversion: 2.1 time: 0.158844 Jun 06 13:17:21.279693 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 552/1080] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:21 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1502 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:21.279891 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-51cc8dc0-6aa5-4a55-a39c-61a26a6c27c8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:21.279891 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-51cc8dc0-6aa5-4a55-a39c-61a26a6c27c8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:21.280640 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-51cc8dc0-6aa5-4a55-a39c-61a26a6c27c8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:21.281081 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-51cc8dc0-6aa5-4a55-a39c-61a26a6c27c8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:21.420638 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-51cc8dc0-6aa5-4a55-a39c-61a26a6c27c8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:21.430289 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-51cc8dc0-6aa5-4a55-a39c-61a26a6c27c8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1258 microversion: 2.1 time: 0.165399 Jun 06 13:17:21.430886 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 529/1081] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:21 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1258 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:22.293011 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fa344f78-b2e7-4778-8dec-8150459f1650 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:22.307007 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fa344f78-b2e7-4778-8dec-8150459f1650 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:22.307007 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa344f78-b2e7-4778-8dec-8150459f1650 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:22.307007 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa344f78-b2e7-4778-8dec-8150459f1650 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:22.307007 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa344f78-b2e7-4778-8dec-8150459f1650 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:22.307718 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fa344f78-b2e7-4778-8dec-8150459f1650 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:22.375667 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fa344f78-b2e7-4778-8dec-8150459f1650 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:22.384457 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fa344f78-b2e7-4778-8dec-8150459f1650 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1460 microversion: 2.1 time: 0.096480 Jun 06 13:17:22.384965 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 553/1082] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:22 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1460 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:22.449908 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-87e3d613-7f70-484f-aa7a-8e9eaae565eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:22.449908 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-87e3d613-7f70-484f-aa7a-8e9eaae565eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:22.455059 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-87e3d613-7f70-484f-aa7a-8e9eaae565eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:22.455563 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-87e3d613-7f70-484f-aa7a-8e9eaae565eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:22.456350 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-87e3d613-7f70-484f-aa7a-8e9eaae565eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:22.457025 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-87e3d613-7f70-484f-aa7a-8e9eaae565eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:22.597787 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-87e3d613-7f70-484f-aa7a-8e9eaae565eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:22.606158 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-87e3d613-7f70-484f-aa7a-8e9eaae565eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1258 microversion: 2.1 time: 0.163285 Jun 06 13:17:22.606718 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 530/1083] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:22 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:22.710768 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-70f81098-f442-483f-88ab-6ce120cd15fd req-a9486e66-9aab-41cf-8b8a-c658d7e3a0de service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "4279db04-3475-4b52-aa10-399e70fd89a3", "name": "network-vif-deleted", "tag": "138c85f5-e057-4800-bf79-d55d3dc4f307"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:22.719413 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-70f81098-f442-483f-88ab-6ce120cd15fd req-a9486e66-9aab-41cf-8b8a-c658d7e3a0de service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:22.720075 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-70f81098-f442-483f-88ab-6ce120cd15fd req-a9486e66-9aab-41cf-8b8a-c658d7e3a0de service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:22.731915 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-70f81098-f442-483f-88ab-6ce120cd15fd req-a9486e66-9aab-41cf-8b8a-c658d7e3a0de service nova] Creating event network-vif-deleted:138c85f5-e057-4800-bf79-d55d3dc4f307 for instance 4279db04-3475-4b52-aa10-399e70fd89a3 on hv-cinder-75510 Jun 06 13:17:22.736654 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-70f81098-f442-483f-88ab-6ce120cd15fd req-a9486e66-9aab-41cf-8b8a-c658d7e3a0de service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030260 Jun 06 13:17:22.737245 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 554/1084] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:17:22 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:17:23.401878 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1b73606c-51ee-4b1c-b77f-7dc3b77f8d5c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:23.402421 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1b73606c-51ee-4b1c-b77f-7dc3b77f8d5c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:23.408571 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1b73606c-51ee-4b1c-b77f-7dc3b77f8d5c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:23.411399 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1b73606c-51ee-4b1c-b77f-7dc3b77f8d5c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:23.411399 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1b73606c-51ee-4b1c-b77f-7dc3b77f8d5c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:23.411399 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1b73606c-51ee-4b1c-b77f-7dc3b77f8d5c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:23.443996 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1b73606c-51ee-4b1c-b77f-7dc3b77f8d5c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:23.444563 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1b73606c-51ee-4b1c-b77f-7dc3b77f8d5c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:23.445053 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-1b73606c-51ee-4b1c-b77f-7dc3b77f8d5c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lazy-loading 'fault' on Instance uuid 4279db04-3475-4b52-aa10-399e70fd89a3 {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:17:23.495282 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1b73606c-51ee-4b1c-b77f-7dc3b77f8d5c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:23.503885 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1b73606c-51ee-4b1c-b77f-7dc3b77f8d5c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 200 len: 1302 microversion: 2.1 time: 0.105997 Jun 06 13:17:23.504488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 531/1085] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:23 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 1302 bytes in 107 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:23.623459 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5398a4c8-f056-42ee-91fe-2e61564379ff tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:23.624205 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5398a4c8-f056-42ee-91fe-2e61564379ff tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:23.630812 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5398a4c8-f056-42ee-91fe-2e61564379ff tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:23.631260 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5398a4c8-f056-42ee-91fe-2e61564379ff tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:23.632138 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5398a4c8-f056-42ee-91fe-2e61564379ff tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:23.632775 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5398a4c8-f056-42ee-91fe-2e61564379ff tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:23.773265 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5398a4c8-f056-42ee-91fe-2e61564379ff tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:23.780847 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5398a4c8-f056-42ee-91fe-2e61564379ff tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1258 microversion: 2.1 time: 0.162334 Jun 06 13:17:23.781405 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 555/1086] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:23 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1258 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:24.524976 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-08926920-c5ca-409f-86bd-4b662a54f91f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:24.525609 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-08926920-c5ca-409f-86bd-4b662a54f91f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 4279db04-3475-4b52-aa10-399e70fd89a3] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:24.532143 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-08926920-c5ca-409f-86bd-4b662a54f91f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:24.532590 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-08926920-c5ca-409f-86bd-4b662a54f91f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:24.533355 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-08926920-c5ca-409f-86bd-4b662a54f91f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:24.533785 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-08926920-c5ca-409f-86bd-4b662a54f91f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:24.548594 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-08926920-c5ca-409f-86bd-4b662a54f91f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] HTTP exception thrown: Instance 4279db04-3475-4b52-aa10-399e70fd89a3 could not be found. Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-08926920-c5ca-409f-86bd-4b662a54f91f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Request method failure captured: Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 HTTP/1.1 Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinf5M3iOV7-3_NtN102RokugFul2Tr98Ld1BEULbpS0oPONi-P6aNS6tl1Uh09k0SuPboNuZY_peqf-pFeQonLkxSQqoffKEPVtTlcwu7yVgUsjW6mOp2bwNPkubBGqlLbn2_nGaQG-r4Yrhh-8nJmf78hEFtOpaYE3aezlsfwKKIkpk Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 2dbb7192ee02406a959af9cc4c2577a2 Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-VolumesActionsTest-466484335 Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:17:24.550480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:17:24.552331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2dbb7192ee02406a959af9cc4c2577a2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2dbb7192ee02406a959af9cc4c2577a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2dbb7192ee02406a959af9cc4c2577a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2dbb7192ee02406a959af9cc4c2577a2"}]}] Jun 06 13:17:24.552331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-VolumesActionsTest-466484335 Jun 06 13:17:24.552331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 2dbb7192ee02406a959af9cc4c2577a2 Jun 06 13:17:24.552331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-VolumesActionsTest-466484335 Jun 06 13:17:24.552331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-VolumesActionsTest-466484335-project Jun 06 13:17:24.552331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:17:24.552331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:17:24.552331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 34e95873c90645b59bd6225c15118847 Jun 06 13:17:24.552331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-VolumesActionsTest-466484335-project Jun 06 13:17:24.552331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:17:24.552331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 4279db04-3475-4b52-aa10-399e70fd89a3 could not be found. Jun 06 13:17:24.552331 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '4279db04-3475-4b52-aa10-399e70fd89a3'} Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 4279db04-3475-4b52-aa10-399e70fd89a3 could not be found. Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:17:24.553415 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 4279db04-3475-4b52-aa10-399e70fd89a3 could not be found. Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 4279db04-3475-4b52-aa10-399e70fd89a3 could not be found. Jun 06 13:17:24.555800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:17:24.557218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-08926920-c5ca-409f-86bd-4b662a54f91f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Returning 404 to user: Instance 4279db04-3475-4b52-aa10-399e70fd89a3 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:17:24.557218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-08926920-c5ca-409f-86bd-4b662a54f91f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3" status: 404 len: 111 microversion: 2.1 time: 0.031156 Jun 06 13:17:24.557218 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 532/1087] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:24 2022] GET /compute/v2.1/servers/4279db04-3475-4b52-aa10-399e70fd89a3 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:17:24.703221 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1992520233", "imageRef": "8e0607d9-b11b-4e97-9c15-7ccd45abb820", "flavorRef": "452", "networks": [{"uuid": "d9842708-303a-498a-a080-8dfa05d3a13f"}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:24.757104 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] validate_networks() for [('d9842708-303a-498a-a080-8dfa05d3a13f', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:17:24.797216 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-93921faf-58fb-4904-bb5c-0a369d1192f7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:24.797863 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-93921faf-58fb-4904-bb5c-0a369d1192f7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:24.804936 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-93921faf-58fb-4904-bb5c-0a369d1192f7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:24.805394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-93921faf-58fb-4904-bb5c-0a369d1192f7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:24.806171 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-93921faf-58fb-4904-bb5c-0a369d1192f7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:24.806603 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-93921faf-58fb-4904-bb5c-0a369d1192f7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:24.993349 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-93921faf-58fb-4904-bb5c-0a369d1192f7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:25.001043 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-93921faf-58fb-4904-bb5c-0a369d1192f7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1258 microversion: 2.1 time: 0.207906 Jun 06 13:17:25.001608 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 533/1088] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:24 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1258 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:25.172796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:17:25.173218 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:17:25.173691 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:17:25.174419 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:17:25.174828 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:17:25.183838 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:25.184286 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:25.185086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:25.185522 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:25.202391 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Getting quotas for project 2dbb7192ee02406a959af9cc4c2577a2. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:17:25.206372 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Getting quotas for user 34e95873c90645b59bd6225c15118847 and project 2dbb7192ee02406a959af9cc4c2577a2. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:17:25.218025 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:17:25.220713 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,guest_format=None,id=,image_id='8e0607d9-b11b-4e97-9c15-7ccd45abb820',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:17:25.345846 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ed6069db-43b1-456d-ac32-f7a291526e0c tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.646398 Jun 06 13:17:25.346694 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 556/1089] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:17:24 2022] POST /compute/v2.1/servers => generated 380 bytes in 648 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:17:25.358195 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9f946526-c344-4e6c-aa43-8c92c4da0f73 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:25.359011 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9f946526-c344-4e6c-aa43-8c92c4da0f73 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:25.361823 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:25.367676 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=6 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:25.424597 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9f946526-c344-4e6c-aa43-8c92c4da0f73 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:25.431706 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9f946526-c344-4e6c-aa43-8c92c4da0f73 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1214 microversion: 2.1 time: 0.077700 Jun 06 13:17:25.432308 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 534/1090] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:25 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1214 bytes in 79 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:26.018078 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8c447ab2-277b-46dc-a57f-eb2820a07128 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:26.018822 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8c447ab2-277b-46dc-a57f-eb2820a07128 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:26.026309 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c447ab2-277b-46dc-a57f-eb2820a07128 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:26.026742 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c447ab2-277b-46dc-a57f-eb2820a07128 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:26.027491 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c447ab2-277b-46dc-a57f-eb2820a07128 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:26.027939 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8c447ab2-277b-46dc-a57f-eb2820a07128 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:26.159462 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-8c447ab2-277b-46dc-a57f-eb2820a07128 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:26.167684 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8c447ab2-277b-46dc-a57f-eb2820a07128 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1258 microversion: 2.1 time: 0.154044 Jun 06 13:17:26.170330 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 557/1091] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:26 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1258 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:26.450921 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-0266b950-d2c1-4e0c-ae41-ed3ab34fa9e5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:26.451520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-0266b950-d2c1-4e0c-ae41-ed3ab34fa9e5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:26.459135 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0266b950-d2c1-4e0c-ae41-ed3ab34fa9e5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:26.459612 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0266b950-d2c1-4e0c-ae41-ed3ab34fa9e5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:26.460578 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0266b950-d2c1-4e0c-ae41-ed3ab34fa9e5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:26.462436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-0266b950-d2c1-4e0c-ae41-ed3ab34fa9e5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:26.523799 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-0266b950-d2c1-4e0c-ae41-ed3ab34fa9e5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:26.531506 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-0266b950-d2c1-4e0c-ae41-ed3ab34fa9e5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1218 microversion: 2.1 time: 0.085965 Jun 06 13:17:26.533440 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 535/1092] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:26 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1218 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:27.185885 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d42ed418-e1a7-42ac-a277-6fe52b9602b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:27.186458 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d42ed418-e1a7-42ac-a277-6fe52b9602b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:27.193147 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d42ed418-e1a7-42ac-a277-6fe52b9602b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:27.193594 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d42ed418-e1a7-42ac-a277-6fe52b9602b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:27.194383 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d42ed418-e1a7-42ac-a277-6fe52b9602b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:27.194817 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d42ed418-e1a7-42ac-a277-6fe52b9602b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:27.379622 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d42ed418-e1a7-42ac-a277-6fe52b9602b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:27.388042 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d42ed418-e1a7-42ac-a277-6fe52b9602b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1258 microversion: 2.1 time: 0.206158 Jun 06 13:17:27.388868 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 558/1093] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:27 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1258 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:27.549367 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ee50e550-fcbf-4ed8-a36e-ae37581b78fc tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:27.550011 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ee50e550-fcbf-4ed8-a36e-ae37581b78fc tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:27.557000 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ee50e550-fcbf-4ed8-a36e-ae37581b78fc tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:27.557635 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ee50e550-fcbf-4ed8-a36e-ae37581b78fc tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:27.558605 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ee50e550-fcbf-4ed8-a36e-ae37581b78fc tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:27.559106 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ee50e550-fcbf-4ed8-a36e-ae37581b78fc tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:27.625986 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ee50e550-fcbf-4ed8-a36e-ae37581b78fc tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:27.634613 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ee50e550-fcbf-4ed8-a36e-ae37581b78fc tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1284 microversion: 2.1 time: 0.089375 Jun 06 13:17:27.638792 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 536/1094] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:27 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:28.405340 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4739dd8e-ceef-46cf-bebc-2dfb8a4aeec0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:28.405954 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4739dd8e-ceef-46cf-bebc-2dfb8a4aeec0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:28.412525 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4739dd8e-ceef-46cf-bebc-2dfb8a4aeec0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:28.412973 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4739dd8e-ceef-46cf-bebc-2dfb8a4aeec0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:28.413739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4739dd8e-ceef-46cf-bebc-2dfb8a4aeec0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:28.414173 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4739dd8e-ceef-46cf-bebc-2dfb8a4aeec0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:28.548042 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4739dd8e-ceef-46cf-bebc-2dfb8a4aeec0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:28.556643 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4739dd8e-ceef-46cf-bebc-2dfb8a4aeec0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1258 microversion: 2.1 time: 0.155131 Jun 06 13:17:28.557306 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 559/1095] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:28 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1258 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:28.651858 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e881f961-7e6c-40f2-9697-f476eb60ee22 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:28.652487 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e881f961-7e6c-40f2-9697-f476eb60ee22 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:28.658646 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e881f961-7e6c-40f2-9697-f476eb60ee22 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:28.659322 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e881f961-7e6c-40f2-9697-f476eb60ee22 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:28.660113 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e881f961-7e6c-40f2-9697-f476eb60ee22 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:28.660536 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e881f961-7e6c-40f2-9697-f476eb60ee22 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:28.795230 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e881f961-7e6c-40f2-9697-f476eb60ee22 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:28.803094 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e881f961-7e6c-40f2-9697-f476eb60ee22 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1314 microversion: 2.1 time: 0.155720 Jun 06 13:17:28.803708 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 537/1096] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:28 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1314 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:29.196052 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-a7fe56d6-e2a1-4402-a54b-c10f53aae4e4 req-70a7dc06-da32-49aa-a194-948ab8697bae service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "48f490c9-ca69-4b60-aa50-14a538482d86", "tag": "48de2e11-1f9c-4807-b351-22c74d170dc7"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:29.204421 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-a7fe56d6-e2a1-4402-a54b-c10f53aae4e4 req-70a7dc06-da32-49aa-a194-948ab8697bae service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:29.204952 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-a7fe56d6-e2a1-4402-a54b-c10f53aae4e4 req-70a7dc06-da32-49aa-a194-948ab8697bae service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:29.216422 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-a7fe56d6-e2a1-4402-a54b-c10f53aae4e4 req-70a7dc06-da32-49aa-a194-948ab8697bae service nova] Creating event network-changed:48de2e11-1f9c-4807-b351-22c74d170dc7 for instance 48f490c9-ca69-4b60-aa50-14a538482d86 on hv-cinder-75510 Jun 06 13:17:29.221283 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-a7fe56d6-e2a1-4402-a54b-c10f53aae4e4 req-70a7dc06-da32-49aa-a194-948ab8697bae service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030255 Jun 06 13:17:29.221877 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 560/1097] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:17:29 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:17:29.574440 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2028202c-9886-454a-9338-bc31695a19b7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:29.575426 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2028202c-9886-454a-9338-bc31695a19b7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:29.581796 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2028202c-9886-454a-9338-bc31695a19b7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:29.582645 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2028202c-9886-454a-9338-bc31695a19b7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:29.583557 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2028202c-9886-454a-9338-bc31695a19b7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:29.584105 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2028202c-9886-454a-9338-bc31695a19b7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:29.729221 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-2028202c-9886-454a-9338-bc31695a19b7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:29.748724 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2028202c-9886-454a-9338-bc31695a19b7 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1258 microversion: 2.1 time: 0.167762 Jun 06 13:17:29.748724 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 538/1098] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:29 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1258 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:29.821723 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b078dab4-11dd-4242-8fce-b6e9052b8653 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:29.822411 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b078dab4-11dd-4242-8fce-b6e9052b8653 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:29.828697 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b078dab4-11dd-4242-8fce-b6e9052b8653 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:29.829080 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b078dab4-11dd-4242-8fce-b6e9052b8653 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:29.829832 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b078dab4-11dd-4242-8fce-b6e9052b8653 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:29.830256 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b078dab4-11dd-4242-8fce-b6e9052b8653 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:29.972847 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b078dab4-11dd-4242-8fce-b6e9052b8653 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:29.981570 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b078dab4-11dd-4242-8fce-b6e9052b8653 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1314 microversion: 2.1 time: 0.164759 Jun 06 13:17:29.982314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 561/1099] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:29 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1314 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:30.755301 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-82a43751-761b-46e9-a68e-e69f3f6a1e66 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:30.755964 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-82a43751-761b-46e9-a68e-e69f3f6a1e66 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:30.764018 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-82a43751-761b-46e9-a68e-e69f3f6a1e66 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:30.764455 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-82a43751-761b-46e9-a68e-e69f3f6a1e66 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:30.765198 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-82a43751-761b-46e9-a68e-e69f3f6a1e66 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:30.765618 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-82a43751-761b-46e9-a68e-e69f3f6a1e66 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:30.892964 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-82a43751-761b-46e9-a68e-e69f3f6a1e66 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:30.901187 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-82a43751-761b-46e9-a68e-e69f3f6a1e66 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1258 microversion: 2.1 time: 0.149687 Jun 06 13:17:30.906783 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 539/1100] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:30 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1258 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:30.999274 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-b2d9a0c8-8a06-4128-81e8-75859a446226 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:30.999896 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-b2d9a0c8-8a06-4128-81e8-75859a446226 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:31.006430 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b2d9a0c8-8a06-4128-81e8-75859a446226 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:31.006868 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b2d9a0c8-8a06-4128-81e8-75859a446226 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:31.007633 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b2d9a0c8-8a06-4128-81e8-75859a446226 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:31.008701 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-b2d9a0c8-8a06-4128-81e8-75859a446226 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:31.137785 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-b2d9a0c8-8a06-4128-81e8-75859a446226 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:31.145618 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-b2d9a0c8-8a06-4128-81e8-75859a446226 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1314 microversion: 2.1 time: 0.150283 Jun 06 13:17:31.146169 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 562/1101] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:30 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1314 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:31.919023 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a0551983-0a8d-4556-8702-c5696f94e314 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:31.919849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a0551983-0a8d-4556-8702-c5696f94e314 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:31.927099 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a0551983-0a8d-4556-8702-c5696f94e314 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:31.927685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a0551983-0a8d-4556-8702-c5696f94e314 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:31.928465 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a0551983-0a8d-4556-8702-c5696f94e314 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:31.928932 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a0551983-0a8d-4556-8702-c5696f94e314 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:31.934033 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=100 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:31.987687 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-2d79f614-05ca-4657-947c-8501805ae6ce req-d639578c-9639-40d7-926a-20c700ec250c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c46a57-7fc5-427b-a56d-aa697322d8a8", "name": "network-vif-plugged", "status": "completed", "tag": "67b1981d-c58b-487a-92c4-bb105c0f52c3"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:31.997838 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-2d79f614-05ca-4657-947c-8501805ae6ce req-d639578c-9639-40d7-926a-20c700ec250c service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:31.998288 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-2d79f614-05ca-4657-947c-8501805ae6ce req-d639578c-9639-40d7-926a-20c700ec250c service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:32.011015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-2d79f614-05ca-4657-947c-8501805ae6ce req-d639578c-9639-40d7-926a-20c700ec250c service nova] Creating event network-vif-plugged:67b1981d-c58b-487a-92c4-bb105c0f52c3 for instance 25c46a57-7fc5-427b-a56d-aa697322d8a8 on hv-cinder-75510 Jun 06 13:17:32.016022 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-2d79f614-05ca-4657-947c-8501805ae6ce req-d639578c-9639-40d7-926a-20c700ec250c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032784 Jun 06 13:17:32.016774 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 563/1102] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:17:31 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:17:32.082385 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a0551983-0a8d-4556-8702-c5696f94e314 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:32.090512 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a0551983-0a8d-4556-8702-c5696f94e314 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1258 microversion: 2.1 time: 0.176159 Jun 06 13:17:32.091079 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 540/1103] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:31 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1258 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:32.162660 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3e47f2d1-9faa-49d5-95d9-ee93a84288c3 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:32.163349 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3e47f2d1-9faa-49d5-95d9-ee93a84288c3 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:32.169868 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e47f2d1-9faa-49d5-95d9-ee93a84288c3 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:32.170314 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e47f2d1-9faa-49d5-95d9-ee93a84288c3 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:32.171071 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e47f2d1-9faa-49d5-95d9-ee93a84288c3 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:32.171503 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3e47f2d1-9faa-49d5-95d9-ee93a84288c3 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:32.176364 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:32.312271 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3e47f2d1-9faa-49d5-95d9-ee93a84288c3 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:32.319933 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3e47f2d1-9faa-49d5-95d9-ee93a84288c3 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1314 microversion: 2.1 time: 0.161390 Jun 06 13:17:32.321306 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 564/1104] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:32 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:33.107267 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-02c215af-1d4b-4977-9b97-3ce12a1fe479 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:33.107898 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-02c215af-1d4b-4977-9b97-3ce12a1fe479 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:33.114319 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-02c215af-1d4b-4977-9b97-3ce12a1fe479 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:33.114757 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-02c215af-1d4b-4977-9b97-3ce12a1fe479 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:33.115504 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-02c215af-1d4b-4977-9b97-3ce12a1fe479 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:33.115957 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-02c215af-1d4b-4977-9b97-3ce12a1fe479 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:33.248442 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-02c215af-1d4b-4977-9b97-3ce12a1fe479 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:33.255838 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-02c215af-1d4b-4977-9b97-3ce12a1fe479 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1258 microversion: 2.1 time: 0.152340 Jun 06 13:17:33.256402 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 541/1105] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:33 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1258 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:33.336904 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-2e0b51f4-a975-400a-b5b9-af1f7fe33340 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:33.337515 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-2e0b51f4-a975-400a-b5b9-af1f7fe33340 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:33.344516 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2e0b51f4-a975-400a-b5b9-af1f7fe33340 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:33.344966 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2e0b51f4-a975-400a-b5b9-af1f7fe33340 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:33.345726 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2e0b51f4-a975-400a-b5b9-af1f7fe33340 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:33.346161 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-2e0b51f4-a975-400a-b5b9-af1f7fe33340 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:33.479424 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-2e0b51f4-a975-400a-b5b9-af1f7fe33340 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:33.487431 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-2e0b51f4-a975-400a-b5b9-af1f7fe33340 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1314 microversion: 2.1 time: 0.154561 Jun 06 13:17:33.488038 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 565/1106] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:33 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1314 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:34.030388 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-311fd73a-38bb-4e3c-95da-53954cab2056 req-5baa801d-2f6d-43b4-a809-fc33569ebbe4 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f490c9-ca69-4b60-aa50-14a538482d86", "name": "network-vif-plugged", "status": "completed", "tag": "48de2e11-1f9c-4807-b351-22c74d170dc7"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:34.038461 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-311fd73a-38bb-4e3c-95da-53954cab2056 req-5baa801d-2f6d-43b4-a809-fc33569ebbe4 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:34.038901 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-311fd73a-38bb-4e3c-95da-53954cab2056 req-5baa801d-2f6d-43b4-a809-fc33569ebbe4 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:34.050324 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-311fd73a-38bb-4e3c-95da-53954cab2056 req-5baa801d-2f6d-43b4-a809-fc33569ebbe4 service nova] Creating event network-vif-plugged:48de2e11-1f9c-4807-b351-22c74d170dc7 for instance 48f490c9-ca69-4b60-aa50-14a538482d86 on hv-cinder-75510 Jun 06 13:17:34.055089 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-311fd73a-38bb-4e3c-95da-53954cab2056 req-5baa801d-2f6d-43b4-a809-fc33569ebbe4 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.028353 Jun 06 13:17:34.055675 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 542/1107] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:17:34 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 30 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:17:34.273193 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-252658fd-04bf-4d3d-bff5-90f2ecbd2ecf tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:34.273713 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-252658fd-04bf-4d3d-bff5-90f2ecbd2ecf tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:34.280572 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-252658fd-04bf-4d3d-bff5-90f2ecbd2ecf tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:34.281018 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-252658fd-04bf-4d3d-bff5-90f2ecbd2ecf tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:34.281780 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-252658fd-04bf-4d3d-bff5-90f2ecbd2ecf tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:34.282208 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-252658fd-04bf-4d3d-bff5-90f2ecbd2ecf tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:34.416426 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-252658fd-04bf-4d3d-bff5-90f2ecbd2ecf tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:34.423983 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-252658fd-04bf-4d3d-bff5-90f2ecbd2ecf tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1442 microversion: 2.1 time: 0.154737 Jun 06 13:17:34.424790 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 566/1108] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:34 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1442 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:34.441035 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-617eb26b-a97d-4060-81ea-3000b55ba12b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:34.441724 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-617eb26b-a97d-4060-81ea-3000b55ba12b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:34.448403 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-617eb26b-a97d-4060-81ea-3000b55ba12b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:34.448847 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-617eb26b-a97d-4060-81ea-3000b55ba12b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:34.449598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-617eb26b-a97d-4060-81ea-3000b55ba12b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:34.450028 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-617eb26b-a97d-4060-81ea-3000b55ba12b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:34.505566 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d894514c-f724-4b21-afd5-add67f607ed8 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:34.506174 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d894514c-f724-4b21-afd5-add67f607ed8 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:34.514016 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d894514c-f724-4b21-afd5-add67f607ed8 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:34.514495 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d894514c-f724-4b21-afd5-add67f607ed8 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:34.515258 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d894514c-f724-4b21-afd5-add67f607ed8 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:34.515704 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d894514c-f724-4b21-afd5-add67f607ed8 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:34.626577 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-617eb26b-a97d-4060-81ea-3000b55ba12b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:34.635009 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-617eb26b-a97d-4060-81ea-3000b55ba12b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1442 microversion: 2.1 time: 0.197744 Jun 06 13:17:34.635598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 543/1109] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:34 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1442 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:34.673407 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d894514c-f724-4b21-afd5-add67f607ed8 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:34.681948 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d894514c-f724-4b21-afd5-add67f607ed8 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1314 microversion: 2.1 time: 0.179651 Jun 06 13:17:34.682904 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 567/1110] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:34 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1314 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:35.699916 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5f128ddd-2360-43d8-b1b9-2b7cb309070f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:35.700521 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5f128ddd-2360-43d8-b1b9-2b7cb309070f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:35.706988 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5f128ddd-2360-43d8-b1b9-2b7cb309070f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:35.707427 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5f128ddd-2360-43d8-b1b9-2b7cb309070f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:35.708223 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5f128ddd-2360-43d8-b1b9-2b7cb309070f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:35.708653 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5f128ddd-2360-43d8-b1b9-2b7cb309070f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:35.850779 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5f128ddd-2360-43d8-b1b9-2b7cb309070f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:35.858500 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5f128ddd-2360-43d8-b1b9-2b7cb309070f tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1499 microversion: 2.1 time: 0.162939 Jun 06 13:17:35.859072 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 544/1111] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:35 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1499 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:36.683301 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-8bfa51a7-612c-4d21-8891-22e68cfcdca1 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:36.684015 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8bfa51a7-612c-4d21-8891-22e68cfcdca1 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:36.686073 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:36.686740 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=8 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:36.691702 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8bfa51a7-612c-4d21-8891-22e68cfcdca1 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:36.692149 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8bfa51a7-612c-4d21-8891-22e68cfcdca1 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:36.692922 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8bfa51a7-612c-4d21-8891-22e68cfcdca1 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:36.693351 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-8bfa51a7-612c-4d21-8891-22e68cfcdca1 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:36.718001 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-8bfa51a7-612c-4d21-8891-22e68cfcdca1 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:17:36.984014 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-ed44af3c-8995-4215-be43-b247788da190 req-a8eb5f4c-23b4-4120-9c03-4194b76eef99 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c46a57-7fc5-427b-a56d-aa697322d8a8", "tag": "67b1981d-c58b-487a-92c4-bb105c0f52c3"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:36.987650 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:17:36.993599 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-ed44af3c-8995-4215-be43-b247788da190 req-a8eb5f4c-23b4-4120-9c03-4194b76eef99 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:36.994044 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-ed44af3c-8995-4215-be43-b247788da190 req-a8eb5f4c-23b4-4120-9c03-4194b76eef99 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:37.000093 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-8bfa51a7-612c-4d21-8891-22e68cfcdca1 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "DELETE /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 204 len: 0 microversion: 2.1 time: 0.321069 Jun 06 13:17:37.000946 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 568/1112] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:17:36 2022] DELETE /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 0 bytes in 323 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:17:37.007689 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-ed44af3c-8995-4215-be43-b247788da190 req-a8eb5f4c-23b4-4120-9c03-4194b76eef99 service nova] Creating event network-changed:67b1981d-c58b-487a-92c4-bb105c0f52c3 for instance 25c46a57-7fc5-427b-a56d-aa697322d8a8 on hv-cinder-75510 Jun 06 13:17:37.009524 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a9eebc33-b70e-4939-bbff-12ed2bea44f5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:37.011983 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a9eebc33-b70e-4939-bbff-12ed2bea44f5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:37.013062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-ed44af3c-8995-4215-be43-b247788da190 req-a8eb5f4c-23b4-4120-9c03-4194b76eef99 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032502 Jun 06 13:17:37.013555 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 545/1113] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:17:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:17:37.021511 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a9eebc33-b70e-4939-bbff-12ed2bea44f5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:37.022119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a9eebc33-b70e-4939-bbff-12ed2bea44f5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:37.022911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a9eebc33-b70e-4939-bbff-12ed2bea44f5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:37.023378 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a9eebc33-b70e-4939-bbff-12ed2bea44f5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:37.160384 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a9eebc33-b70e-4939-bbff-12ed2bea44f5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:37.168132 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a9eebc33-b70e-4939-bbff-12ed2bea44f5 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1505 microversion: 2.1 time: 0.162843 Jun 06 13:17:37.168820 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 569/1114] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:37 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1505 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:17:38.190006 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9492dee9-202e-4a58-b54a-4607dd6dcf15 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:38.190773 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9492dee9-202e-4a58-b54a-4607dd6dcf15 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:38.197330 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9492dee9-202e-4a58-b54a-4607dd6dcf15 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:38.197846 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9492dee9-202e-4a58-b54a-4607dd6dcf15 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:38.198613 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9492dee9-202e-4a58-b54a-4607dd6dcf15 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:38.199054 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9492dee9-202e-4a58-b54a-4607dd6dcf15 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:38.328463 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9492dee9-202e-4a58-b54a-4607dd6dcf15 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:38.335853 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9492dee9-202e-4a58-b54a-4607dd6dcf15 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1505 microversion: 2.1 time: 0.153707 Jun 06 13:17:38.336418 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 546/1115] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:38 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:39.353453 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d67b784f-4eac-447a-b5d1-91267451c3e2 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:39.354057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d67b784f-4eac-447a-b5d1-91267451c3e2 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:39.360558 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d67b784f-4eac-447a-b5d1-91267451c3e2 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:39.361000 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d67b784f-4eac-447a-b5d1-91267451c3e2 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:39.361753 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d67b784f-4eac-447a-b5d1-91267451c3e2 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:39.362176 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d67b784f-4eac-447a-b5d1-91267451c3e2 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:39.494845 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d67b784f-4eac-447a-b5d1-91267451c3e2 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:39.503297 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d67b784f-4eac-447a-b5d1-91267451c3e2 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1505 microversion: 2.1 time: 0.153240 Jun 06 13:17:39.503909 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 570/1116] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:39 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1505 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:39.647488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-d494c123-13e5-4421-9950-f9f16b094640 req-d1a7d1e9-70e5-4594-aee7-7ae6ccf4a197 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "48f490c9-ca69-4b60-aa50-14a538482d86", "name": "network-vif-deleted", "tag": "48de2e11-1f9c-4807-b351-22c74d170dc7"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:17:39.656707 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-d494c123-13e5-4421-9950-f9f16b094640 req-d1a7d1e9-70e5-4594-aee7-7ae6ccf4a197 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:39.657176 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-d494c123-13e5-4421-9950-f9f16b094640 req-d1a7d1e9-70e5-4594-aee7-7ae6ccf4a197 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:39.668141 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-d494c123-13e5-4421-9950-f9f16b094640 req-d1a7d1e9-70e5-4594-aee7-7ae6ccf4a197 service nova] Creating event network-vif-deleted:48de2e11-1f9c-4807-b351-22c74d170dc7 for instance 48f490c9-ca69-4b60-aa50-14a538482d86 on hv-cinder-75510 Jun 06 13:17:39.672943 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-d494c123-13e5-4421-9950-f9f16b094640 req-d1a7d1e9-70e5-4594-aee7-7ae6ccf4a197 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029228 Jun 06 13:17:39.673509 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 547/1117] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:17:39 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:17:40.520560 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-d6bdeb8a-7b69-4a80-8283-2524e640bc92 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:40.521154 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-d6bdeb8a-7b69-4a80-8283-2524e640bc92 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:40.527778 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d6bdeb8a-7b69-4a80-8283-2524e640bc92 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:40.528222 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d6bdeb8a-7b69-4a80-8283-2524e640bc92 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:40.529029 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d6bdeb8a-7b69-4a80-8283-2524e640bc92 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:40.529513 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d6bdeb8a-7b69-4a80-8283-2524e640bc92 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:40.561791 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d6bdeb8a-7b69-4a80-8283-2524e640bc92 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:40.562232 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-d6bdeb8a-7b69-4a80-8283-2524e640bc92 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:40.562751 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.objects.instance [None req-d6bdeb8a-7b69-4a80-8283-2524e640bc92 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lazy-loading 'fault' on Instance uuid 48f490c9-ca69-4b60-aa50-14a538482d86 {{(pid=118133) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:17:40.607658 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-d6bdeb8a-7b69-4a80-8283-2524e640bc92 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '34e95873c90645b59bd6225c15118847', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '2dbb7192ee02406a959af9cc4c2577a2', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:17:40.614508 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-d6bdeb8a-7b69-4a80-8283-2524e640bc92 tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 200 len: 1304 microversion: 2.1 time: 0.097826 Jun 06 13:17:40.619191 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 571/1118] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:40 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:17:41.633173 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b8e8ca32-46b1-41d4-acbd-7f155f13356b tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:17:41.633861 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b8e8ca32-46b1-41d4-acbd-7f155f13356b tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] [instance: 48f490c9-ca69-4b60-aa50-14a538482d86] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:17:41.640332 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b8e8ca32-46b1-41d4-acbd-7f155f13356b tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:41.640775 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b8e8ca32-46b1-41d4-acbd-7f155f13356b tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:41.641530 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b8e8ca32-46b1-41d4-acbd-7f155f13356b tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:17:41.641957 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b8e8ca32-46b1-41d4-acbd-7f155f13356b tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:17:41.655809 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-b8e8ca32-46b1-41d4-acbd-7f155f13356b tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] HTTP exception thrown: Instance 48f490c9-ca69-4b60-aa50-14a538482d86 could not be found. Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b8e8ca32-46b1-41d4-acbd-7f155f13356b tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Request method failure captured: Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 HTTP/1.1 Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinf5M3iOV7-3_NtN102RokugFul2Tr98Ld1BEULbpS0oPONi-P6aNS6tl1Uh09k0SuPboNuZY_peqf-pFeQonLkxSQqoffKEPVtTlcwu7yVgUsjW6mOp2bwNPkubBGqlLbn2_nGaQG-r4Yrhh-8nJmf78hEFtOpaYE3aezlsfwKKIkpk Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 2dbb7192ee02406a959af9cc4c2577a2 Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-VolumesActionsTest-466484335 Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:17:41.657417 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:17:41.659062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_2dbb7192ee02406a959af9cc4c2577a2", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2dbb7192ee02406a959af9cc4c2577a2"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/2dbb7192ee02406a959af9cc4c2577a2"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/2dbb7192ee02406a959af9cc4c2577a2"}]}] Jun 06 13:17:41.659062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-VolumesActionsTest-466484335 Jun 06 13:17:41.659062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 2dbb7192ee02406a959af9cc4c2577a2 Jun 06 13:17:41.659062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-VolumesActionsTest-466484335 Jun 06 13:17:41.659062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-VolumesActionsTest-466484335-project Jun 06 13:17:41.659062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:17:41.659062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:17:41.659062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: 34e95873c90645b59bd6225c15118847 Jun 06 13:17:41.659062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-VolumesActionsTest-466484335-project Jun 06 13:17:41.659062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:17:41.659062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 48f490c9-ca69-4b60-aa50-14a538482d86 could not be found. Jun 06 13:17:41.659062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '48f490c9-ca69-4b60-aa50-14a538482d86'} Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 48f490c9-ca69-4b60-aa50-14a538482d86 could not be found. Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:17:41.660046 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 48f490c9-ca69-4b60-aa50-14a538482d86 could not be found. Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 48f490c9-ca69-4b60-aa50-14a538482d86 could not be found. Jun 06 13:17:41.661567 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:17:41.663136 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b8e8ca32-46b1-41d4-acbd-7f155f13356b tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] Returning 404 to user: Instance 48f490c9-ca69-4b60-aa50-14a538482d86 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:17:41.663136 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b8e8ca32-46b1-41d4-acbd-7f155f13356b tempest-VolumesActionsTest-466484335 tempest-VolumesActionsTest-466484335-project] 10.222.0.13 "GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86" status: 404 len: 111 microversion: 2.1 time: 0.030309 Jun 06 13:17:41.663136 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 548/1119] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:17:41 2022] GET /compute/v2.1/servers/48f490c9-ca69-4b60-aa50-14a538482d86 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:18:44.414731 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 13:18:44.415456 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Mon Jun 6 13:18:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 13:18:55.673515 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:UPDATE=2,nova_api:SELECT=61,nova_api:INSERT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:18:55.674268 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=56,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:18:55.678538 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-385718750", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-182726226", "security_groups": [{"name": "tempest-secgroup-smoke-99823546"}], "block_device_mapping_v2": [{"uuid": "fb7950b7-403c-48eb-bef5-b2a42bac661f", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "ad4e33a2-2cb6-465f-b54a-3fcb95401137"}]}} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:18:55.950080 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.network.neutron [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] validate_networks() for [('ad4e33a2-2cb6-465f-b54a-3fcb95401137', None, None, None, None, None)] {{(pid=118133) validate_networks /opt/stack/nova/nova/network/neutron.py:2609}} Jun 06 13:18:56.417466 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Flavor limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Jun 06 13:18:56.417937 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Image limits 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Jun 06 13:18:56.418412 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Flavor pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Jun 06 13:18:56.418817 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Image pref 0:0:0 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Jun 06 13:18:56.419278 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.virt.hardware [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=118133) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Jun 06 13:18:56.428840 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:18:56.429288 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:18:56.430087 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:18:56.430523 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:18:56.449159 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Getting quotas for project 332996ee21f54ef3b78907332f5decce. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:393}} Jun 06 13:18:56.454087 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.quota [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Getting quotas for user bd78c278513540ecadfc1a0f90b9ab16 and project 332996ee21f54ef3b78907332f5decce. Resources: {'cores', 'ram', 'instances'} {{(pid=118133) _get_quotas /opt/stack/nova/nova/quota.py:383}} Jun 06 13:18:56.510823 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Going to run 1 instances... {{(pid=118133) _provision_instances /opt/stack/nova/nova/compute/api.py:1389}} Jun 06 13:18:56.512910 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='fb7950b7-403c-48eb-bef5-b2a42bac661f',volume_size=None,volume_type=None)] {{(pid=118133) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1807}} Jun 06 13:18:56.892030 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9b766dcc-f5db-4c3e-9d1d-0198046ebca4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "POST /compute/v2.1/servers" status: 202 len: 404 microversion: 2.1 time: 1.221129 Jun 06 13:18:56.893010 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 572/1120] 10.222.0.13 () {60 vars in 1146 bytes} [Mon Jun 6 13:18:55 2022] POST /compute/v2.1/servers => generated 404 bytes in 1223 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Jun 06 13:18:56.900409 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=43 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:18:56.901163 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=36 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:18:56.905666 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1ee0eb2d-bc56-4d55-aa97-89e2906ceabc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:18:56.906199 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1ee0eb2d-bc56-4d55-aa97-89e2906ceabc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:18:57.062037 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-1ee0eb2d-bc56-4d55-aa97-89e2906ceabc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:18:57.070107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1ee0eb2d-bc56-4d55-aa97-89e2906ceabc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1093 microversion: 2.1 time: 0.171418 Jun 06 13:18:57.070662 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 549/1121] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:18:56 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1093 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:18:58.088329 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-cac41233-a156-44db-b557-726e82d6d0ea tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:18:58.088929 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-cac41233-a156-44db-b557-726e82d6d0ea tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:18:58.097070 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cac41233-a156-44db-b557-726e82d6d0ea tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:18:58.098745 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cac41233-a156-44db-b557-726e82d6d0ea tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:18:58.098745 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cac41233-a156-44db-b557-726e82d6d0ea tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:18:58.099177 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-cac41233-a156-44db-b557-726e82d6d0ea tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:18:58.162607 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-cac41233-a156-44db-b557-726e82d6d0ea tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:18:58.170264 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-cac41233-a156-44db-b557-726e82d6d0ea tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1135 microversion: 2.1 time: 0.086176 Jun 06 13:18:58.171310 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 573/1122] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:18:58 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1135 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:18:59.188661 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-fbbb97fe-071c-43fd-9e89-a160ee7757ef tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:18:59.189273 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-fbbb97fe-071c-43fd-9e89-a160ee7757ef tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:18:59.195845 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fbbb97fe-071c-43fd-9e89-a160ee7757ef tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:18:59.196297 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fbbb97fe-071c-43fd-9e89-a160ee7757ef tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:18:59.197130 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fbbb97fe-071c-43fd-9e89-a160ee7757ef tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:18:59.197554 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-fbbb97fe-071c-43fd-9e89-a160ee7757ef tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:18:59.260229 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-fbbb97fe-071c-43fd-9e89-a160ee7757ef tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:18:59.268292 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-fbbb97fe-071c-43fd-9e89-a160ee7757ef tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1209 microversion: 2.1 time: 0.083968 Jun 06 13:18:59.268861 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 550/1123] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:18:59 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1209 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:00.286155 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-c6038bd7-ea25-40c8-a645-d94d74f23112 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:00.286762 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-c6038bd7-ea25-40c8-a645-d94d74f23112 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:00.298063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6038bd7-ea25-40c8-a645-d94d74f23112 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:00.298063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6038bd7-ea25-40c8-a645-d94d74f23112 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:00.298063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6038bd7-ea25-40c8-a645-d94d74f23112 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:00.298063 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-c6038bd7-ea25-40c8-a645-d94d74f23112 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:00.446028 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-c6038bd7-ea25-40c8-a645-d94d74f23112 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:00.454548 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-c6038bd7-ea25-40c8-a645-d94d74f23112 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1263 microversion: 2.1 time: 0.172193 Jun 06 13:19:00.455123 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 574/1124] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:00 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1263 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:00.573961 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-0d6c2bb1-333c-4221-a9b0-24ae7c18c2fd req-3cef6153-cf39-4acb-b787-864527440d45 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "474e8555-6336-44ea-a14d-e2f522b05840", "tag": "7353a7f4-166b-45de-9542-d890523846a6"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:19:00.586107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-0d6c2bb1-333c-4221-a9b0-24ae7c18c2fd req-3cef6153-cf39-4acb-b787-864527440d45 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:00.586107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-0d6c2bb1-333c-4221-a9b0-24ae7c18c2fd req-3cef6153-cf39-4acb-b787-864527440d45 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:00.599810 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-0d6c2bb1-333c-4221-a9b0-24ae7c18c2fd req-3cef6153-cf39-4acb-b787-864527440d45 service nova] Creating event network-changed:7353a7f4-166b-45de-9542-d890523846a6 for instance 474e8555-6336-44ea-a14d-e2f522b05840 on hv-cinder-75510 Jun 06 13:19:00.604574 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-0d6c2bb1-333c-4221-a9b0-24ae7c18c2fd req-3cef6153-cf39-4acb-b787-864527440d45 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036397 Jun 06 13:19:00.605172 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 551/1125] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:19:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:19:01.471698 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-ed50252e-695e-4b72-a35b-f59179497584 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:01.472311 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-ed50252e-695e-4b72-a35b-f59179497584 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:01.478831 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed50252e-695e-4b72-a35b-f59179497584 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:01.479263 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed50252e-695e-4b72-a35b-f59179497584 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:01.480060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed50252e-695e-4b72-a35b-f59179497584 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:01.480498 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-ed50252e-695e-4b72-a35b-f59179497584 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:01.609739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-ed50252e-695e-4b72-a35b-f59179497584 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:01.617136 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-ed50252e-695e-4b72-a35b-f59179497584 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1263 microversion: 2.1 time: 0.149430 Jun 06 13:19:01.617703 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 575/1126] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:01 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1263 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:02.635241 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-2459cadd-3792-4a64-9152-77321fac0922 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:02.635951 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-2459cadd-3792-4a64-9152-77321fac0922 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:02.642743 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2459cadd-3792-4a64-9152-77321fac0922 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:02.643185 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2459cadd-3792-4a64-9152-77321fac0922 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:02.643970 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2459cadd-3792-4a64-9152-77321fac0922 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:02.644399 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-2459cadd-3792-4a64-9152-77321fac0922 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:02.775728 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-2459cadd-3792-4a64-9152-77321fac0922 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:02.784285 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-2459cadd-3792-4a64-9152-77321fac0922 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1263 microversion: 2.1 time: 0.153622 Jun 06 13:19:02.784854 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 552/1127] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:02 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1263 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:03.802618 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-77b8a4bd-e75c-431f-b848-a9e015b6cad5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:03.803159 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-77b8a4bd-e75c-431f-b848-a9e015b6cad5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:03.809755 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77b8a4bd-e75c-431f-b848-a9e015b6cad5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:03.810201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77b8a4bd-e75c-431f-b848-a9e015b6cad5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:03.811056 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77b8a4bd-e75c-431f-b848-a9e015b6cad5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:03.811675 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-77b8a4bd-e75c-431f-b848-a9e015b6cad5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:03.942709 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-77b8a4bd-e75c-431f-b848-a9e015b6cad5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:03.950273 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-77b8a4bd-e75c-431f-b848-a9e015b6cad5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1263 microversion: 2.1 time: 0.151961 Jun 06 13:19:03.950836 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 576/1128] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:03 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:04.966113 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9f09476c-1d69-48f5-9dae-47fab0047729 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:04.966743 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9f09476c-1d69-48f5-9dae-47fab0047729 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:04.974486 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9f09476c-1d69-48f5-9dae-47fab0047729 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:04.974931 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9f09476c-1d69-48f5-9dae-47fab0047729 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:04.975716 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9f09476c-1d69-48f5-9dae-47fab0047729 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:04.976143 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9f09476c-1d69-48f5-9dae-47fab0047729 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:05.103043 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9f09476c-1d69-48f5-9dae-47fab0047729 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:05.110429 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9f09476c-1d69-48f5-9dae-47fab0047729 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1263 microversion: 2.1 time: 0.148159 Jun 06 13:19:05.110981 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 553/1129] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:04 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1263 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:06.127066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-a8c8b805-2497-44d4-a1c7-bbdc322b65cc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:06.127722 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-a8c8b805-2497-44d4-a1c7-bbdc322b65cc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:06.133870 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8c8b805-2497-44d4-a1c7-bbdc322b65cc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:06.134309 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8c8b805-2497-44d4-a1c7-bbdc322b65cc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:06.135055 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8c8b805-2497-44d4-a1c7-bbdc322b65cc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:06.135481 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-a8c8b805-2497-44d4-a1c7-bbdc322b65cc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:06.266957 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-a8c8b805-2497-44d4-a1c7-bbdc322b65cc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:06.274532 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-a8c8b805-2497-44d4-a1c7-bbdc322b65cc tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1263 microversion: 2.1 time: 0.151424 Jun 06 13:19:06.275103 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 577/1130] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:06 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:07.291576 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-effe4894-0762-43f0-ba0a-4253b264e805 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:07.292196 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-effe4894-0762-43f0-ba0a-4253b264e805 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:07.294364 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell0:SELECT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:19:07.299662 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-effe4894-0762-43f0-ba0a-4253b264e805 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:07.300112 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-effe4894-0762-43f0-ba0a-4253b264e805 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:07.301131 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-effe4894-0762-43f0-ba0a-4253b264e805 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:07.301564 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-effe4894-0762-43f0-ba0a-4253b264e805 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:07.434920 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-effe4894-0762-43f0-ba0a-4253b264e805 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:07.443328 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-effe4894-0762-43f0-ba0a-4253b264e805 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1263 microversion: 2.1 time: 0.155641 Jun 06 13:19:07.443924 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 554/1131] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:07 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1263 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:08.461163 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-f1968a18-4805-4369-be0a-0db8985d7500 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:08.461688 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-f1968a18-4805-4369-be0a-0db8985d7500 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:08.463611 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=2 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:19:08.464281 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell0:SELECT=6 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:19:08.470327 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1968a18-4805-4369-be0a-0db8985d7500 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:08.472779 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1968a18-4805-4369-be0a-0db8985d7500 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:08.472779 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1968a18-4805-4369-be0a-0db8985d7500 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:08.472779 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-f1968a18-4805-4369-be0a-0db8985d7500 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:08.849735 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-f1968a18-4805-4369-be0a-0db8985d7500 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:08.857459 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-f1968a18-4805-4369-be0a-0db8985d7500 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1263 microversion: 2.1 time: 0.400199 Jun 06 13:19:08.858133 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 578/1132] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:08 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1263 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:09.874220 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c1b01998-2545-4b0f-8f23-8ff364237ebf tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:09.874826 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c1b01998-2545-4b0f-8f23-8ff364237ebf tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:09.881329 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1b01998-2545-4b0f-8f23-8ff364237ebf tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:09.881776 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1b01998-2545-4b0f-8f23-8ff364237ebf tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:09.882769 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1b01998-2545-4b0f-8f23-8ff364237ebf tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:09.882942 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c1b01998-2545-4b0f-8f23-8ff364237ebf tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:10.013596 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-c1b01998-2545-4b0f-8f23-8ff364237ebf tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:10.021862 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c1b01998-2545-4b0f-8f23-8ff364237ebf tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1263 microversion: 2.1 time: 0.151631 Jun 06 13:19:10.022428 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 555/1133] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:09 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1263 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:10.220154 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-0e8c09d1-c567-4e04-9e32-31f54f5953f7 req-d6705523-1305-46a2-81af-39ea4e8f7ad0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474e8555-6336-44ea-a14d-e2f522b05840", "name": "network-vif-plugged", "status": "completed", "tag": "7353a7f4-166b-45de-9542-d890523846a6"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:19:10.228319 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-0e8c09d1-c567-4e04-9e32-31f54f5953f7 req-d6705523-1305-46a2-81af-39ea4e8f7ad0 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:10.228759 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-0e8c09d1-c567-4e04-9e32-31f54f5953f7 req-d6705523-1305-46a2-81af-39ea4e8f7ad0 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:10.239563 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-0e8c09d1-c567-4e04-9e32-31f54f5953f7 req-d6705523-1305-46a2-81af-39ea4e8f7ad0 service nova] Creating event network-vif-plugged:7353a7f4-166b-45de-9542-d890523846a6 for instance 474e8555-6336-44ea-a14d-e2f522b05840 on hv-cinder-75510 Jun 06 13:19:10.244390 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-0e8c09d1-c567-4e04-9e32-31f54f5953f7 req-d6705523-1305-46a2-81af-39ea4e8f7ad0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.086696 Jun 06 13:19:10.244988 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 579/1134] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:19:10 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:19:11.038411 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-71dac987-4405-42ea-81c1-dbdac7bbb090 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:11.039019 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-71dac987-4405-42ea-81c1-dbdac7bbb090 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:11.046175 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71dac987-4405-42ea-81c1-dbdac7bbb090 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:11.046801 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71dac987-4405-42ea-81c1-dbdac7bbb090 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:11.047582 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71dac987-4405-42ea-81c1-dbdac7bbb090 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:11.048027 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-71dac987-4405-42ea-81c1-dbdac7bbb090 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:11.179821 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-71dac987-4405-42ea-81c1-dbdac7bbb090 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:11.187371 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-71dac987-4405-42ea-81c1-dbdac7bbb090 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1263 microversion: 2.1 time: 0.152769 Jun 06 13:19:11.187970 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 556/1135] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:11 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1263 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:12.205608 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-337a7f3c-7714-48b8-a4ec-eeb5391968a5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:12.206215 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-337a7f3c-7714-48b8-a4ec-eeb5391968a5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:12.212463 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-337a7f3c-7714-48b8-a4ec-eeb5391968a5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:12.212909 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-337a7f3c-7714-48b8-a4ec-eeb5391968a5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:12.214185 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-337a7f3c-7714-48b8-a4ec-eeb5391968a5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:12.214185 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-337a7f3c-7714-48b8-a4ec-eeb5391968a5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:12.345731 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-337a7f3c-7714-48b8-a4ec-eeb5391968a5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:12.353333 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-337a7f3c-7714-48b8-a4ec-eeb5391968a5 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1449 microversion: 2.1 time: 0.153175 Jun 06 13:19:12.353897 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 580/1136] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:12 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1449 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:12.370091 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-75b32b05-a9ee-42ee-b972-f796c5bbd111 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:12.370697 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-75b32b05-a9ee-42ee-b972-f796c5bbd111 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:12.377812 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-75b32b05-a9ee-42ee-b972-f796c5bbd111 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:12.378257 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-75b32b05-a9ee-42ee-b972-f796c5bbd111 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:12.379021 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-75b32b05-a9ee-42ee-b972-f796c5bbd111 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:12.379463 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-75b32b05-a9ee-42ee-b972-f796c5bbd111 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:12.509380 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-75b32b05-a9ee-42ee-b972-f796c5bbd111 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:12.516949 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-75b32b05-a9ee-42ee-b972-f796c5bbd111 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1449 microversion: 2.1 time: 0.150725 Jun 06 13:19:12.517508 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 557/1137] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:12 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1449 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:14.458335 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-fdbbd997-b9a9-4fd8-af15-2292d268e2c3 req-1cd90748-5390-4c4a-a7b4-a3921809af6c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "474e8555-6336-44ea-a14d-e2f522b05840", "tag": "7353a7f4-166b-45de-9542-d890523846a6"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:19:14.466402 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-fdbbd997-b9a9-4fd8-af15-2292d268e2c3 req-1cd90748-5390-4c4a-a7b4-a3921809af6c service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:14.466833 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-fdbbd997-b9a9-4fd8-af15-2292d268e2c3 req-1cd90748-5390-4c4a-a7b4-a3921809af6c service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:14.478102 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-fdbbd997-b9a9-4fd8-af15-2292d268e2c3 req-1cd90748-5390-4c4a-a7b4-a3921809af6c service nova] Creating event network-changed:7353a7f4-166b-45de-9542-d890523846a6 for instance 474e8555-6336-44ea-a14d-e2f522b05840 on hv-cinder-75510 Jun 06 13:19:14.483823 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-fdbbd997-b9a9-4fd8-af15-2292d268e2c3 req-1cd90748-5390-4c4a-a7b4-a3921809af6c service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.085625 Jun 06 13:19:14.484870 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 581/1138] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:19:14 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:19:37.493518 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6985c60f-1bdf-4650-9e82-48c1874f150f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:19:37.494153 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6985c60f-1bdf-4650-9e82-48c1874f150f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:37.496062 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=20 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:19:37.496727 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=44 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:19:37.501737 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6985c60f-1bdf-4650-9e82-48c1874f150f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:37.502183 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6985c60f-1bdf-4650-9e82-48c1874f150f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:37.502943 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6985c60f-1bdf-4650-9e82-48c1874f150f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:37.503376 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6985c60f-1bdf-4650-9e82-48c1874f150f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:37.526212 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.objects.instance [None req-6985c60f-1bdf-4650-9e82-48c1874f150f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lazy-loading 'flavor' on Instance uuid 25c46a57-7fc5-427b-a56d-aa697322d8a8 {{(pid=118134) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1099}} Jun 06 13:19:37.756164 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6985c60f-1bdf-4650-9e82-48c1874f150f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "POST /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8/action" status: 202 len: 0 microversion: 2.1 time: 0.266372 Jun 06 13:19:37.756665 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 558/1139] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:19:37 2022] POST /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8/action => generated 0 bytes in 268 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:19:37.767056 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-067f486c-1e54-4c08-a71d-b12d4f8a3566 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:37.767819 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-067f486c-1e54-4c08-a71d-b12d4f8a3566 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:37.770113 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=3 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:19:37.770753 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=48 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:19:37.775724 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-067f486c-1e54-4c08-a71d-b12d4f8a3566 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:37.776144 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-067f486c-1e54-4c08-a71d-b12d4f8a3566 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:37.776895 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-067f486c-1e54-4c08-a71d-b12d4f8a3566 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:37.777321 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-067f486c-1e54-4c08-a71d-b12d4f8a3566 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:37.913568 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-067f486c-1e54-4c08-a71d-b12d4f8a3566 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:37.921324 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-067f486c-1e54-4c08-a71d-b12d4f8a3566 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.159262 Jun 06 13:19:37.921923 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 582/1140] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:37 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:38.939515 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4904c2a8-8a76-48c9-9420-1affbe5284d1 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:38.940239 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-4904c2a8-8a76-48c9-9420-1affbe5284d1 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:38.946456 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4904c2a8-8a76-48c9-9420-1affbe5284d1 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:38.946902 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4904c2a8-8a76-48c9-9420-1affbe5284d1 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:38.947686 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4904c2a8-8a76-48c9-9420-1affbe5284d1 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:38.948117 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4904c2a8-8a76-48c9-9420-1affbe5284d1 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:39.082429 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-4904c2a8-8a76-48c9-9420-1affbe5284d1 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:39.089997 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-4904c2a8-8a76-48c9-9420-1affbe5284d1 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.155313 Jun 06 13:19:39.090559 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 559/1141] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:38 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:40.107551 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4141683b-d1f3-4afd-b0f2-50b8893779d2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:40.108146 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-4141683b-d1f3-4afd-b0f2-50b8893779d2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:40.114542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4141683b-d1f3-4afd-b0f2-50b8893779d2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:40.114983 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4141683b-d1f3-4afd-b0f2-50b8893779d2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:40.115759 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4141683b-d1f3-4afd-b0f2-50b8893779d2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:40.116187 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-4141683b-d1f3-4afd-b0f2-50b8893779d2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:40.246441 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-4141683b-d1f3-4afd-b0f2-50b8893779d2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:40.253871 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4141683b-d1f3-4afd-b0f2-50b8893779d2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.150760 Jun 06 13:19:40.254437 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 583/1142] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:40 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:41.271036 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-6fc0af32-300b-44d6-90ed-cfbadde8740f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:41.271612 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-6fc0af32-300b-44d6-90ed-cfbadde8740f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:41.277931 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6fc0af32-300b-44d6-90ed-cfbadde8740f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:41.278370 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6fc0af32-300b-44d6-90ed-cfbadde8740f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:41.279702 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6fc0af32-300b-44d6-90ed-cfbadde8740f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:41.280125 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-6fc0af32-300b-44d6-90ed-cfbadde8740f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:41.411608 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-6fc0af32-300b-44d6-90ed-cfbadde8740f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:41.419001 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-6fc0af32-300b-44d6-90ed-cfbadde8740f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.151887 Jun 06 13:19:41.420168 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 560/1143] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:41 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:42.437486 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-873a6086-0e02-4699-950b-51e20aca34a4 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:42.438209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-873a6086-0e02-4699-950b-51e20aca34a4 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:42.444915 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-873a6086-0e02-4699-950b-51e20aca34a4 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:42.445362 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-873a6086-0e02-4699-950b-51e20aca34a4 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:42.446201 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-873a6086-0e02-4699-950b-51e20aca34a4 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:42.446773 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-873a6086-0e02-4699-950b-51e20aca34a4 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:42.576035 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-873a6086-0e02-4699-950b-51e20aca34a4 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:42.583494 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-873a6086-0e02-4699-950b-51e20aca34a4 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.150636 Jun 06 13:19:42.584091 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 584/1144] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:42 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:43.600436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-ba7bef15-0507-43f8-877f-d2de52f980fa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:43.601042 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-ba7bef15-0507-43f8-877f-d2de52f980fa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:43.607663 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ba7bef15-0507-43f8-877f-d2de52f980fa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:43.608110 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ba7bef15-0507-43f8-877f-d2de52f980fa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:43.608865 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ba7bef15-0507-43f8-877f-d2de52f980fa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:43.609301 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-ba7bef15-0507-43f8-877f-d2de52f980fa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:43.743460 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-ba7bef15-0507-43f8-877f-d2de52f980fa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:43.751503 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-ba7bef15-0507-43f8-877f-d2de52f980fa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.154940 Jun 06 13:19:43.752081 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 561/1145] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:43 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:44.768968 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-0ac0fb18-8762-4798-93b6-948e77c3aa73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:44.769570 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-0ac0fb18-8762-4798-93b6-948e77c3aa73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:44.776022 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ac0fb18-8762-4798-93b6-948e77c3aa73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:44.776458 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ac0fb18-8762-4798-93b6-948e77c3aa73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:44.777202 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ac0fb18-8762-4798-93b6-948e77c3aa73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:44.777623 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-0ac0fb18-8762-4798-93b6-948e77c3aa73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:44.905877 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-0ac0fb18-8762-4798-93b6-948e77c3aa73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:44.913633 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-0ac0fb18-8762-4798-93b6-948e77c3aa73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.148514 Jun 06 13:19:44.914221 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 585/1146] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:44 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:45.931504 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4c1a5000-4de3-4baa-80d1-d179940a6898 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:45.933107 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-4c1a5000-4de3-4baa-80d1-d179940a6898 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:45.938655 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4c1a5000-4de3-4baa-80d1-d179940a6898 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:45.939094 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4c1a5000-4de3-4baa-80d1-d179940a6898 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:45.939874 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4c1a5000-4de3-4baa-80d1-d179940a6898 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:45.940305 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4c1a5000-4de3-4baa-80d1-d179940a6898 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:46.072401 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-4c1a5000-4de3-4baa-80d1-d179940a6898 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:46.080842 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-4c1a5000-4de3-4baa-80d1-d179940a6898 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.153298 Jun 06 13:19:46.081408 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 562/1147] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:45 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:47.097803 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-364ed6ed-841d-40da-9e67-201400d15a73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:47.098401 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-364ed6ed-841d-40da-9e67-201400d15a73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:47.104843 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-364ed6ed-841d-40da-9e67-201400d15a73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:47.105282 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-364ed6ed-841d-40da-9e67-201400d15a73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:47.106030 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-364ed6ed-841d-40da-9e67-201400d15a73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:47.106455 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-364ed6ed-841d-40da-9e67-201400d15a73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:47.236168 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-364ed6ed-841d-40da-9e67-201400d15a73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:47.243662 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-364ed6ed-841d-40da-9e67-201400d15a73 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.149699 Jun 06 13:19:47.244213 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 586/1148] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:47 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:48.261354 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-abdc1fe7-4203-4ffa-86f9-8055e1c3453c tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:48.261981 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-abdc1fe7-4203-4ffa-86f9-8055e1c3453c tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:48.268730 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abdc1fe7-4203-4ffa-86f9-8055e1c3453c tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:48.269184 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abdc1fe7-4203-4ffa-86f9-8055e1c3453c tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:48.269959 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abdc1fe7-4203-4ffa-86f9-8055e1c3453c tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:48.270394 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-abdc1fe7-4203-4ffa-86f9-8055e1c3453c tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:48.401408 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-abdc1fe7-4203-4ffa-86f9-8055e1c3453c tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:48.409233 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-abdc1fe7-4203-4ffa-86f9-8055e1c3453c tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.151702 Jun 06 13:19:48.409854 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 563/1149] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:48 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:49.426684 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-517a9ca4-5877-4f71-bdee-ea06a6762871 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:49.427282 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-517a9ca4-5877-4f71-bdee-ea06a6762871 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:49.434086 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-517a9ca4-5877-4f71-bdee-ea06a6762871 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:49.434528 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-517a9ca4-5877-4f71-bdee-ea06a6762871 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:49.435269 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-517a9ca4-5877-4f71-bdee-ea06a6762871 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:49.436341 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-517a9ca4-5877-4f71-bdee-ea06a6762871 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:49.571691 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-517a9ca4-5877-4f71-bdee-ea06a6762871 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:49.579986 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-517a9ca4-5877-4f71-bdee-ea06a6762871 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.157373 Jun 06 13:19:49.580567 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 587/1150] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:49 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:50.597531 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5c4d861c-d520-4d96-b037-904eefb7306a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:50.598258 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5c4d861c-d520-4d96-b037-904eefb7306a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:50.604881 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c4d861c-d520-4d96-b037-904eefb7306a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:50.605323 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c4d861c-d520-4d96-b037-904eefb7306a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:50.606094 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c4d861c-d520-4d96-b037-904eefb7306a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:50.606525 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5c4d861c-d520-4d96-b037-904eefb7306a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:50.743069 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5c4d861c-d520-4d96-b037-904eefb7306a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:50.753369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5c4d861c-d520-4d96-b037-904eefb7306a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.159683 Jun 06 13:19:50.753993 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 564/1151] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:50 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:51.770163 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-6d491e09-1fc9-446b-9dc5-95cf669f16eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:51.770793 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-6d491e09-1fc9-446b-9dc5-95cf669f16eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:51.777327 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6d491e09-1fc9-446b-9dc5-95cf669f16eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:51.777780 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6d491e09-1fc9-446b-9dc5-95cf669f16eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:51.778542 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6d491e09-1fc9-446b-9dc5-95cf669f16eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:51.779513 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-6d491e09-1fc9-446b-9dc5-95cf669f16eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:51.915448 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-6d491e09-1fc9-446b-9dc5-95cf669f16eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:51.924212 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-6d491e09-1fc9-446b-9dc5-95cf669f16eb tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1508 microversion: 2.1 time: 0.157903 Jun 06 13:19:51.924767 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 588/1152] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:51 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1508 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:51.940517 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-b83c227a-ccf4-4fcf-8c4b-7e237520f6f5 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:19:51.941093 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-b83c227a-ccf4-4fcf-8c4b-7e237520f6f5 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:51.947582 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b83c227a-ccf4-4fcf-8c4b-7e237520f6f5 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:51.948038 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b83c227a-ccf4-4fcf-8c4b-7e237520f6f5 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:51.948803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b83c227a-ccf4-4fcf-8c4b-7e237520f6f5 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:51.949239 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-b83c227a-ccf4-4fcf-8c4b-7e237520f6f5 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:52.136507 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-b83c227a-ccf4-4fcf-8c4b-7e237520f6f5 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "POST /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8/action" status: 202 len: 0 microversion: 2.1 time: 0.199778 Jun 06 13:19:52.137113 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 565/1153] 10.222.0.13 () {60 vars in 1277 bytes} [Mon Jun 6 13:19:51 2022] POST /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8/action => generated 0 bytes in 201 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:19:52.146936 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3497e1f2-61f9-4c7b-a463-fb7dc17f21b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:52.147932 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3497e1f2-61f9-4c7b-a463-fb7dc17f21b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:52.153626 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3497e1f2-61f9-4c7b-a463-fb7dc17f21b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:52.154717 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3497e1f2-61f9-4c7b-a463-fb7dc17f21b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:52.155827 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3497e1f2-61f9-4c7b-a463-fb7dc17f21b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:52.156288 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3497e1f2-61f9-4c7b-a463-fb7dc17f21b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:52.291751 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3497e1f2-61f9-4c7b-a463-fb7dc17f21b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:52.297669 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3497e1f2-61f9-4c7b-a463-fb7dc17f21b6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1516 microversion: 2.1 time: 0.154953 Jun 06 13:19:52.298375 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 589/1154] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:52 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:53.315112 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-93cf3a0f-6b09-4039-949c-487a1f424bc0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:53.315717 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-93cf3a0f-6b09-4039-949c-487a1f424bc0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:53.321689 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-93cf3a0f-6b09-4039-949c-487a1f424bc0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:53.322133 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-93cf3a0f-6b09-4039-949c-487a1f424bc0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:53.322886 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-93cf3a0f-6b09-4039-949c-487a1f424bc0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:53.323318 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-93cf3a0f-6b09-4039-949c-487a1f424bc0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:53.457924 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-93cf3a0f-6b09-4039-949c-487a1f424bc0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:53.465809 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-93cf3a0f-6b09-4039-949c-487a1f424bc0 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1516 microversion: 2.1 time: 0.155160 Jun 06 13:19:53.466916 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 566/1155] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:53 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:54.321349 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-418b6488-1e54-4a24-83ff-26a0c7c8df4f req-08eca67f-943d-4b26-a731-8f5fa20f28d2 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c46a57-7fc5-427b-a56d-aa697322d8a8", "name": "network-vif-unplugged", "status": "completed", "tag": "67b1981d-c58b-487a-92c4-bb105c0f52c3"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:19:54.330470 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-418b6488-1e54-4a24-83ff-26a0c7c8df4f req-08eca67f-943d-4b26-a731-8f5fa20f28d2 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:54.330915 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-418b6488-1e54-4a24-83ff-26a0c7c8df4f req-08eca67f-943d-4b26-a731-8f5fa20f28d2 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:54.342315 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.compute.server_external_events [req-418b6488-1e54-4a24-83ff-26a0c7c8df4f req-08eca67f-943d-4b26-a731-8f5fa20f28d2 service nova] Unable to find a host for instance 25c46a57-7fc5-427b-a56d-aa697322d8a8. Dropping event network-vif-unplugged {{(pid=118133) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:143}} Jun 06 13:19:54.343211 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-418b6488-1e54-4a24-83ff-26a0c7c8df4f req-08eca67f-943d-4b26-a731-8f5fa20f28d2 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.026262 Jun 06 13:19:54.343822 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 590/1156] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:19:54 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 27 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Jun 06 13:19:54.483497 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5f2c7b38-f361-43fc-81c6-e4e8355eb2b2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:54.484079 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5f2c7b38-f361-43fc-81c6-e4e8355eb2b2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:54.490544 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5f2c7b38-f361-43fc-81c6-e4e8355eb2b2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:54.490990 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5f2c7b38-f361-43fc-81c6-e4e8355eb2b2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:54.491769 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5f2c7b38-f361-43fc-81c6-e4e8355eb2b2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:54.492198 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5f2c7b38-f361-43fc-81c6-e4e8355eb2b2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:54.625595 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5f2c7b38-f361-43fc-81c6-e4e8355eb2b2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:54.633151 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5f2c7b38-f361-43fc-81c6-e4e8355eb2b2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1516 microversion: 2.1 time: 0.154035 Jun 06 13:19:54.633915 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 567/1157] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:54 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:55.650152 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-440875f4-8169-45fc-affe-d765663f1ffc tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:55.650796 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-440875f4-8169-45fc-affe-d765663f1ffc tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:55.658417 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-440875f4-8169-45fc-affe-d765663f1ffc tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:55.658864 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-440875f4-8169-45fc-affe-d765663f1ffc tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:55.659651 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-440875f4-8169-45fc-affe-d765663f1ffc tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:55.660092 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-440875f4-8169-45fc-affe-d765663f1ffc tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:55.792767 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-440875f4-8169-45fc-affe-d765663f1ffc tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:55.800859 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-440875f4-8169-45fc-affe-d765663f1ffc tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1516 microversion: 2.1 time: 0.154633 Jun 06 13:19:55.801689 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 591/1158] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:55 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1516 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:56.817999 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-e0dbb79c-5381-41ad-ae2a-864ec0b1bcf6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:56.818800 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-e0dbb79c-5381-41ad-ae2a-864ec0b1bcf6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:56.825058 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e0dbb79c-5381-41ad-ae2a-864ec0b1bcf6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:56.825497 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e0dbb79c-5381-41ad-ae2a-864ec0b1bcf6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:56.826248 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e0dbb79c-5381-41ad-ae2a-864ec0b1bcf6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:56.827252 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-e0dbb79c-5381-41ad-ae2a-864ec0b1bcf6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:56.959429 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-e0dbb79c-5381-41ad-ae2a-864ec0b1bcf6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:56.968099 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-e0dbb79c-5381-41ad-ae2a-864ec0b1bcf6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1516 microversion: 2.1 time: 0.153387 Jun 06 13:19:56.971790 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 568/1159] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:56 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1516 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:57.986282 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-5e25a57e-6cc2-422c-ae1d-35479adc0913 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:57.986977 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-5e25a57e-6cc2-422c-ae1d-35479adc0913 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:57.993609 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e25a57e-6cc2-422c-ae1d-35479adc0913 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:57.994153 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e25a57e-6cc2-422c-ae1d-35479adc0913 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:57.994928 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e25a57e-6cc2-422c-ae1d-35479adc0913 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:57.995367 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-5e25a57e-6cc2-422c-ae1d-35479adc0913 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:58.130699 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-5e25a57e-6cc2-422c-ae1d-35479adc0913 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:58.138410 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-5e25a57e-6cc2-422c-ae1d-35479adc0913 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1518 microversion: 2.1 time: 0.157008 Jun 06 13:19:58.138983 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 592/1160] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:57 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1518 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:19:59.155924 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-cfb031ed-f215-4170-a5ee-10d34e8af15b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:19:59.156617 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-cfb031ed-f215-4170-a5ee-10d34e8af15b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:19:59.163875 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cfb031ed-f215-4170-a5ee-10d34e8af15b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:59.165529 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cfb031ed-f215-4170-a5ee-10d34e8af15b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:59.165529 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cfb031ed-f215-4170-a5ee-10d34e8af15b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:19:59.165529 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-cfb031ed-f215-4170-a5ee-10d34e8af15b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:19:59.297262 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-cfb031ed-f215-4170-a5ee-10d34e8af15b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:19:59.305144 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-cfb031ed-f215-4170-a5ee-10d34e8af15b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1574 microversion: 2.1 time: 0.153166 Jun 06 13:19:59.305711 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 569/1161] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:19:59 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:00.323720 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-9c7ba751-e470-423b-835e-0d264ee45a8b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:00.324264 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-9c7ba751-e470-423b-835e-0d264ee45a8b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:00.331593 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9c7ba751-e470-423b-835e-0d264ee45a8b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:00.332050 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9c7ba751-e470-423b-835e-0d264ee45a8b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:00.332809 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9c7ba751-e470-423b-835e-0d264ee45a8b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:00.333249 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-9c7ba751-e470-423b-835e-0d264ee45a8b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:00.462752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-9c7ba751-e470-423b-835e-0d264ee45a8b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:00.470780 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-9c7ba751-e470-423b-835e-0d264ee45a8b tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1574 microversion: 2.1 time: 0.151043 Jun 06 13:20:00.471366 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 593/1162] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:00 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:01.487287 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-970c2718-92b9-4f1e-a314-d9ec1de33d0f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:01.487938 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-970c2718-92b9-4f1e-a314-d9ec1de33d0f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:01.494552 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-970c2718-92b9-4f1e-a314-d9ec1de33d0f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:01.495059 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-970c2718-92b9-4f1e-a314-d9ec1de33d0f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:01.495861 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-970c2718-92b9-4f1e-a314-d9ec1de33d0f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:01.496300 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-970c2718-92b9-4f1e-a314-d9ec1de33d0f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:01.629541 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-970c2718-92b9-4f1e-a314-d9ec1de33d0f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:01.637231 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-970c2718-92b9-4f1e-a314-d9ec1de33d0f tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1574 microversion: 2.1 time: 0.154392 Jun 06 13:20:01.637865 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 570/1163] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:01 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:02.654163 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-01e0334a-011d-4d7a-97f0-49dc82906878 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:02.654701 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-01e0334a-011d-4d7a-97f0-49dc82906878 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:02.661256 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-01e0334a-011d-4d7a-97f0-49dc82906878 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:02.661698 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-01e0334a-011d-4d7a-97f0-49dc82906878 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:02.662446 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-01e0334a-011d-4d7a-97f0-49dc82906878 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:02.662870 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-01e0334a-011d-4d7a-97f0-49dc82906878 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:02.793394 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-01e0334a-011d-4d7a-97f0-49dc82906878 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:02.800886 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-01e0334a-011d-4d7a-97f0-49dc82906878 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1574 microversion: 2.1 time: 0.150662 Jun 06 13:20:02.801715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 594/1164] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:02 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:03.818486 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-5785240a-47c5-4b21-9a2d-59c80fb4dcaa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:03.819022 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-5785240a-47c5-4b21-9a2d-59c80fb4dcaa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:03.825599 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5785240a-47c5-4b21-9a2d-59c80fb4dcaa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:03.826050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5785240a-47c5-4b21-9a2d-59c80fb4dcaa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:03.826843 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5785240a-47c5-4b21-9a2d-59c80fb4dcaa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:03.828480 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-5785240a-47c5-4b21-9a2d-59c80fb4dcaa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:03.847621 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:20:03.964059 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-5785240a-47c5-4b21-9a2d-59c80fb4dcaa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:03.971672 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-5785240a-47c5-4b21-9a2d-59c80fb4dcaa tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1574 microversion: 2.1 time: 0.157084 Jun 06 13:20:03.972233 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 571/1165] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:03 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1574 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:04.989230 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-528bdf1b-ea5a-4f04-9538-d015004159ae tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:04.989829 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-528bdf1b-ea5a-4f04-9538-d015004159ae tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:04.996301 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-528bdf1b-ea5a-4f04-9538-d015004159ae tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:04.996738 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-528bdf1b-ea5a-4f04-9538-d015004159ae tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:04.997487 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-528bdf1b-ea5a-4f04-9538-d015004159ae tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:04.997910 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-528bdf1b-ea5a-4f04-9538-d015004159ae tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:05.132093 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-528bdf1b-ea5a-4f04-9538-d015004159ae tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:05.139775 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-528bdf1b-ea5a-4f04-9538-d015004159ae tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1574 microversion: 2.1 time: 0.154418 Jun 06 13:20:05.152506 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 595/1166] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:04 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1574 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:06.157953 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-70df519e-3b95-418f-bb14-58ab42200965 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:06.158627 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-70df519e-3b95-418f-bb14-58ab42200965 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:06.164770 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-70df519e-3b95-418f-bb14-58ab42200965 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:06.165214 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-70df519e-3b95-418f-bb14-58ab42200965 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:06.166007 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-70df519e-3b95-418f-bb14-58ab42200965 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:06.166438 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-70df519e-3b95-418f-bb14-58ab42200965 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:06.298270 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-70df519e-3b95-418f-bb14-58ab42200965 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:06.306367 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-70df519e-3b95-418f-bb14-58ab42200965 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1574 microversion: 2.1 time: 0.153221 Jun 06 13:20:06.306937 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 572/1167] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:06 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1574 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:07.324473 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-dc4a2b4e-a26b-4dd0-816c-e6db70bf88c6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:07.325090 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-dc4a2b4e-a26b-4dd0-816c-e6db70bf88c6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:07.331890 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc4a2b4e-a26b-4dd0-816c-e6db70bf88c6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:07.332337 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc4a2b4e-a26b-4dd0-816c-e6db70bf88c6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:07.333084 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc4a2b4e-a26b-4dd0-816c-e6db70bf88c6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:07.333511 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-dc4a2b4e-a26b-4dd0-816c-e6db70bf88c6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:07.462857 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-dc4a2b4e-a26b-4dd0-816c-e6db70bf88c6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:07.470958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-dc4a2b4e-a26b-4dd0-816c-e6db70bf88c6 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1574 microversion: 2.1 time: 0.150509 Jun 06 13:20:07.471546 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 596/1168] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:07 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1574 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:08.460309 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-e1cdb785-bdb1-4f55-afff-5311b5f3751a req-1795b89e-2402-4bdb-8c7a-3c0ed1da9957 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c46a57-7fc5-427b-a56d-aa697322d8a8", "name": "network-vif-plugged", "status": "completed", "tag": "67b1981d-c58b-487a-92c4-bb105c0f52c3"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:20:08.464175 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=33 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:20:08.469723 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-e1cdb785-bdb1-4f55-afff-5311b5f3751a req-1795b89e-2402-4bdb-8c7a-3c0ed1da9957 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:08.470152 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-e1cdb785-bdb1-4f55-afff-5311b5f3751a req-1795b89e-2402-4bdb-8c7a-3c0ed1da9957 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:08.480938 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-e1cdb785-bdb1-4f55-afff-5311b5f3751a req-1795b89e-2402-4bdb-8c7a-3c0ed1da9957 service nova] Creating event network-vif-plugged:67b1981d-c58b-487a-92c4-bb105c0f52c3 for instance 25c46a57-7fc5-427b-a56d-aa697322d8a8 on hv-cinder-75510 Jun 06 13:20:08.486498 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-e1cdb785-bdb1-4f55-afff-5311b5f3751a req-1795b89e-2402-4bdb-8c7a-3c0ed1da9957 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029874 Jun 06 13:20:08.487078 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 573/1169] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:20:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:20:08.490411 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-fc900503-30b3-4e93-9da7-df406317899a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:08.491133 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-fc900503-30b3-4e93-9da7-df406317899a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:08.498518 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fc900503-30b3-4e93-9da7-df406317899a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:08.499692 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fc900503-30b3-4e93-9da7-df406317899a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:08.500481 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fc900503-30b3-4e93-9da7-df406317899a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:08.500970 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-fc900503-30b3-4e93-9da7-df406317899a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:08.505167 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=87 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:20:08.641409 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-fc900503-30b3-4e93-9da7-df406317899a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:08.649004 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-fc900503-30b3-4e93-9da7-df406317899a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1574 microversion: 2.1 time: 0.162983 Jun 06 13:20:08.650199 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 597/1170] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:08 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1574 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:20:09.668531 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-49ea8240-a637-47df-adce-4e2d048e2fc2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:09.669252 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-49ea8240-a637-47df-adce-4e2d048e2fc2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:09.676435 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-49ea8240-a637-47df-adce-4e2d048e2fc2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:09.676886 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-49ea8240-a637-47df-adce-4e2d048e2fc2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:09.677639 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-49ea8240-a637-47df-adce-4e2d048e2fc2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:09.678075 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-49ea8240-a637-47df-adce-4e2d048e2fc2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:09.815283 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-49ea8240-a637-47df-adce-4e2d048e2fc2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:09.822874 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-49ea8240-a637-47df-adce-4e2d048e2fc2 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1574 microversion: 2.1 time: 0.159167 Jun 06 13:20:09.823458 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 574/1171] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:09 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:10.841060 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-3b419517-ad7a-4823-99bc-05c61a54296a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:10.841694 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-3b419517-ad7a-4823-99bc-05c61a54296a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:10.844657 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=33 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:20:10.849621 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3b419517-ad7a-4823-99bc-05c61a54296a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:10.850070 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3b419517-ad7a-4823-99bc-05c61a54296a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:10.850818 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3b419517-ad7a-4823-99bc-05c61a54296a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:10.851249 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-3b419517-ad7a-4823-99bc-05c61a54296a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:10.981752 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-3b419517-ad7a-4823-99bc-05c61a54296a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:10.990046 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-3b419517-ad7a-4823-99bc-05c61a54296a tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1561 microversion: 2.1 time: 0.153274 Jun 06 13:20:10.990620 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 598/1172] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:10 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1561 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:42.328842 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-1fdd93da-c583-4677-927c-6cce5dd73033 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:42.329403 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1fdd93da-c583-4677-927c-6cce5dd73033 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:42.330529 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-401eae1a-75ce-4fd6-821f-d6942d755520 req-d62d5ae4-2237-4e19-98e7-53fee12dbb79 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "474e8555-6336-44ea-a14d-e2f522b05840", "tag": "7353a7f4-166b-45de-9542-d890523846a6"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:20:42.332867 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=3 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:20:42.333535 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=16 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:20:42.337174 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1fdd93da-c583-4677-927c-6cce5dd73033 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:42.337621 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1fdd93da-c583-4677-927c-6cce5dd73033 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:42.338496 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=1 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:20:42.338782 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1fdd93da-c583-4677-927c-6cce5dd73033 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:42.339157 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-1fdd93da-c583-4677-927c-6cce5dd73033 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:42.339271 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=11 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:20:42.341210 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-401eae1a-75ce-4fd6-821f-d6942d755520 req-d62d5ae4-2237-4e19-98e7-53fee12dbb79 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:42.343150 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-401eae1a-75ce-4fd6-821f-d6942d755520 req-d62d5ae4-2237-4e19-98e7-53fee12dbb79 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:42.354468 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-401eae1a-75ce-4fd6-821f-d6942d755520 req-d62d5ae4-2237-4e19-98e7-53fee12dbb79 service nova] Creating event network-changed:7353a7f4-166b-45de-9542-d890523846a6 for instance 474e8555-6336-44ea-a14d-e2f522b05840 on hv-cinder-75510 Jun 06 13:20:42.360665 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-401eae1a-75ce-4fd6-821f-d6942d755520 req-d62d5ae4-2237-4e19-98e7-53fee12dbb79 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034251 Jun 06 13:20:42.361528 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 599/1173] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:20:42 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:20:42.369501 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-1fdd93da-c583-4677-927c-6cce5dd73033 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Going to try to terminate instance {{(pid=118134) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:20:42.659630 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-1fdd93da-c583-4677-927c-6cce5dd73033 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "DELETE /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 204 len: 0 microversion: 2.1 time: 0.335378 Jun 06 13:20:42.660228 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 575/1174] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:20:42 2022] DELETE /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 0 bytes in 337 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:20:42.669688 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-82285bc8-8980-4bbc-99ed-85620f018529 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:42.670463 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-82285bc8-8980-4bbc-99ed-85620f018529 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:42.678545 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82285bc8-8980-4bbc-99ed-85620f018529 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:42.679036 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82285bc8-8980-4bbc-99ed-85620f018529 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:42.679944 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82285bc8-8980-4bbc-99ed-85620f018529 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:42.680379 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-82285bc8-8980-4bbc-99ed-85620f018529 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:42.833548 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-82285bc8-8980-4bbc-99ed-85620f018529 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:42.841509 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-82285bc8-8980-4bbc-99ed-85620f018529 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1574 microversion: 2.1 time: 0.176441 Jun 06 13:20:42.845377 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 600/1175] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:42 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1574 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:43.860765 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-3d0176c1-b691-45f7-9bd9-2f815e499bec tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:43.861369 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-3d0176c1-b691-45f7-9bd9-2f815e499bec tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:43.867907 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d0176c1-b691-45f7-9bd9-2f815e499bec tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:43.868355 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d0176c1-b691-45f7-9bd9-2f815e499bec tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:43.869119 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d0176c1-b691-45f7-9bd9-2f815e499bec tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:43.869551 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-3d0176c1-b691-45f7-9bd9-2f815e499bec tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:44.007961 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-3d0176c1-b691-45f7-9bd9-2f815e499bec tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:44.015793 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-3d0176c1-b691-45f7-9bd9-2f815e499bec tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1574 microversion: 2.1 time: 0.160034 Jun 06 13:20:44.016360 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 576/1176] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:43 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1574 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:44.905256 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-b3579069-e342-423b-8be7-889a6ab580fe req-7a6ee78f-7c74-431f-a632-96386387e36f service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "474e8555-6336-44ea-a14d-e2f522b05840", "name": "network-vif-deleted", "tag": "7353a7f4-166b-45de-9542-d890523846a6"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:20:44.913654 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-b3579069-e342-423b-8be7-889a6ab580fe req-7a6ee78f-7c74-431f-a632-96386387e36f service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:44.914092 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-b3579069-e342-423b-8be7-889a6ab580fe req-7a6ee78f-7c74-431f-a632-96386387e36f service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:44.925576 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-b3579069-e342-423b-8be7-889a6ab580fe req-7a6ee78f-7c74-431f-a632-96386387e36f service nova] Creating event network-vif-deleted:7353a7f4-166b-45de-9542-d890523846a6 for instance 474e8555-6336-44ea-a14d-e2f522b05840 on hv-cinder-75510 Jun 06 13:20:44.930707 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-b3579069-e342-423b-8be7-889a6ab580fe req-7a6ee78f-7c74-431f-a632-96386387e36f service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.133765 Jun 06 13:20:44.933547 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 601/1177] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:20:44 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 135 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:20:45.033319 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-9048ca76-7d7d-4471-ad12-ebfece7af16c tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:45.033868 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-9048ca76-7d7d-4471-ad12-ebfece7af16c tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:45.040275 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9048ca76-7d7d-4471-ad12-ebfece7af16c tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:45.040711 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9048ca76-7d7d-4471-ad12-ebfece7af16c tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:45.041467 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9048ca76-7d7d-4471-ad12-ebfece7af16c tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:45.041888 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-9048ca76-7d7d-4471-ad12-ebfece7af16c tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:45.104704 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-9048ca76-7d7d-4471-ad12-ebfece7af16c tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:45.112836 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-9048ca76-7d7d-4471-ad12-ebfece7af16c tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 200 len: 1224 microversion: 2.1 time: 0.083646 Jun 06 13:20:45.113615 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 577/1178] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:45 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 1224 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:46.131698 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-135f5a07-bcf8-404d-89b0-1fb22c0229c8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:46.132382 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-135f5a07-bcf8-404d-89b0-1fb22c0229c8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 474e8555-6336-44ea-a14d-e2f522b05840] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:46.138515 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-135f5a07-bcf8-404d-89b0-1fb22c0229c8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:46.138954 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-135f5a07-bcf8-404d-89b0-1fb22c0229c8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:46.139751 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-135f5a07-bcf8-404d-89b0-1fb22c0229c8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:46.140755 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-135f5a07-bcf8-404d-89b0-1fb22c0229c8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:46.153396 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-135f5a07-bcf8-404d-89b0-1fb22c0229c8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] HTTP exception thrown: Instance 474e8555-6336-44ea-a14d-e2f522b05840 could not be found. Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-135f5a07-bcf8-404d-89b0-1fb22c0229c8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Request method failure captured: Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 HTTP/1.1 Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinf2MuCZsj-CgS1IjgHzRKLaRb-09GdyOYzcb2-rBEiujh8GyrbydjpigUkAXOCxWJF3i_9kSriSbQc-n2ge8Z7Xa93skgHqi5_t73d74O3toeuSN5vDYc4ZFAKN5ZHI3aurv3zrRGmc0sQVg9tta6C3u4ZzHg5RtzkBBPYHK-21VJ4g Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: 332996ee21f54ef3b78907332f5decce Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-TestVolumeBootPattern-810099065 Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:20:46.154958 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:20:46.157209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_332996ee21f54ef3b78907332f5decce", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/332996ee21f54ef3b78907332f5decce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/332996ee21f54ef3b78907332f5decce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/332996ee21f54ef3b78907332f5decce"}]}] Jun 06 13:20:46.157209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-TestVolumeBootPattern-810099065 Jun 06 13:20:46.157209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 332996ee21f54ef3b78907332f5decce Jun 06 13:20:46.157209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-TestVolumeBootPattern-810099065 Jun 06 13:20:46.157209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-TestVolumeBootPattern-810099065-project Jun 06 13:20:46.157209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:20:46.157209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:20:46.157209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: bd78c278513540ecadfc1a0f90b9ab16 Jun 06 13:20:46.157209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-TestVolumeBootPattern-810099065-project Jun 06 13:20:46.157209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:20:46.157209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance 474e8555-6336-44ea-a14d-e2f522b05840 could not be found. Jun 06 13:20:46.157209 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': '474e8555-6336-44ea-a14d-e2f522b05840'} Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 474e8555-6336-44ea-a14d-e2f522b05840 could not be found. Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:20:46.158057 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 474e8555-6336-44ea-a14d-e2f522b05840 could not be found. Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 474e8555-6336-44ea-a14d-e2f522b05840 could not be found. Jun 06 13:20:46.159449 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:46.160775 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-135f5a07-bcf8-404d-89b0-1fb22c0229c8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Returning 404 to user: Instance 474e8555-6336-44ea-a14d-e2f522b05840 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:20:46.160775 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-135f5a07-bcf8-404d-89b0-1fb22c0229c8 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840" status: 404 len: 111 microversion: 2.1 time: 0.029916 Jun 06 13:20:46.160775 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 602/1179] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:46 2022] GET /compute/v2.1/servers/474e8555-6336-44ea-a14d-e2f522b05840 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:20:49.931241 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-c60f17aa-65f3-4854-b538-b634a0370864 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:49.931866 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c60f17aa-65f3-4854-b538-b634a0370864 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:49.932190 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-e86b0211-2422-4af8-9e31-142bc3f13e12 req-ecd0ef00-4b8a-437a-ae40-ffc714f48d88 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d88f29a9-f0a6-491c-9b00-a2e5430ad5f5", "tag": "5f84d587-2cc8-4dcb-89d9-9d016ea2cffc"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:20:49.938816 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c60f17aa-65f3-4854-b538-b634a0370864 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:49.943057 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c60f17aa-65f3-4854-b538-b634a0370864 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:49.943057 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c60f17aa-65f3-4854-b538-b634a0370864 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:49.943057 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-c60f17aa-65f3-4854-b538-b634a0370864 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:49.943471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-e86b0211-2422-4af8-9e31-142bc3f13e12 req-ecd0ef00-4b8a-437a-ae40-ffc714f48d88 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:49.943471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-e86b0211-2422-4af8-9e31-142bc3f13e12 req-ecd0ef00-4b8a-437a-ae40-ffc714f48d88 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:49.956372 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-e86b0211-2422-4af8-9e31-142bc3f13e12 req-ecd0ef00-4b8a-437a-ae40-ffc714f48d88 service nova] Creating event network-changed:5f84d587-2cc8-4dcb-89d9-9d016ea2cffc for instance d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 on hv-cinder-75510 Jun 06 13:20:49.961568 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-e86b0211-2422-4af8-9e31-142bc3f13e12 req-ecd0ef00-4b8a-437a-ae40-ffc714f48d88 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033109 Jun 06 13:20:49.962596 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 603/1180] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:20:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:20:49.968122 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-c60f17aa-65f3-4854-b538-b634a0370864 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Going to try to terminate instance {{(pid=118134) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:20:50.267249 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-c60f17aa-65f3-4854-b538-b634a0370864 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "DELETE /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 204 len: 0 microversion: 2.1 time: 0.341178 Jun 06 13:20:50.267875 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 578/1181] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:20:49 2022] DELETE /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 0 bytes in 343 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Jun 06 13:20:50.276657 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-e0469225-f4d0-4673-af8c-76000913f8e4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:50.280924 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-e0469225-f4d0-4673-af8c-76000913f8e4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:50.284700 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e0469225-f4d0-4673-af8c-76000913f8e4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:50.285155 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e0469225-f4d0-4673-af8c-76000913f8e4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:50.285935 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e0469225-f4d0-4673-af8c-76000913f8e4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:50.286489 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-e0469225-f4d0-4673-af8c-76000913f8e4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:50.433901 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-e0469225-f4d0-4673-af8c-76000913f8e4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:50.442517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-e0469225-f4d0-4673-af8c-76000913f8e4 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1575 microversion: 2.1 time: 0.170023 Jun 06 13:20:50.443396 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 604/1182] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:50 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1575 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:20:51.461715 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-92b73858-a07d-4358-b0a2-32965a7313ad tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:51.462436 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-92b73858-a07d-4358-b0a2-32965a7313ad tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:51.471646 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-92b73858-a07d-4358-b0a2-32965a7313ad tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:51.472395 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-92b73858-a07d-4358-b0a2-32965a7313ad tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:51.473685 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-92b73858-a07d-4358-b0a2-32965a7313ad tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:51.474422 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-92b73858-a07d-4358-b0a2-32965a7313ad tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:51.628111 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-92b73858-a07d-4358-b0a2-32965a7313ad tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:51.636124 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-92b73858-a07d-4358-b0a2-32965a7313ad tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1575 microversion: 2.1 time: 0.179563 Jun 06 13:20:51.636696 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 579/1183] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:51 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1575 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:52.268290 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [req-cdc18a42-0e74-4c4c-a80e-6ef976911ffa req-d08482cd-ab12-4513-83b8-8f73ffae6845 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d88f29a9-f0a6-491c-9b00-a2e5430ad5f5", "name": "network-vif-deleted", "tag": "5f84d587-2cc8-4dcb-89d9-9d016ea2cffc"}]} {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:20:52.276890 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-cdc18a42-0e74-4c4c-a80e-6ef976911ffa req-d08482cd-ab12-4513-83b8-8f73ffae6845 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:52.277320 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [req-cdc18a42-0e74-4c4c-a80e-6ef976911ffa req-d08482cd-ab12-4513-83b8-8f73ffae6845 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:52.289330 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.compute.server_external_events [req-cdc18a42-0e74-4c4c-a80e-6ef976911ffa req-d08482cd-ab12-4513-83b8-8f73ffae6845 service nova] Creating event network-vif-deleted:5f84d587-2cc8-4dcb-89d9-9d016ea2cffc for instance d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 on hv-cinder-75510 Jun 06 13:20:52.294560 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [req-cdc18a42-0e74-4c4c-a80e-6ef976911ffa req-d08482cd-ab12-4513-83b8-8f73ffae6845 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.029994 Jun 06 13:20:52.295146 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 605/1184] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:20:52 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:20:52.655317 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-a4ea239e-7203-41df-8844-c5978e7f0ec3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:52.656145 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-a4ea239e-7203-41df-8844-c5978e7f0ec3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:52.663640 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a4ea239e-7203-41df-8844-c5978e7f0ec3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:52.664088 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a4ea239e-7203-41df-8844-c5978e7f0ec3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:52.664867 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a4ea239e-7203-41df-8844-c5978e7f0ec3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:52.665294 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-a4ea239e-7203-41df-8844-c5978e7f0ec3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:52.734101 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-a4ea239e-7203-41df-8844-c5978e7f0ec3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'bd78c278513540ecadfc1a0f90b9ab16', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '332996ee21f54ef3b78907332f5decce', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:20:52.742050 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-a4ea239e-7203-41df-8844-c5978e7f0ec3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 200 len: 1225 microversion: 2.1 time: 0.090753 Jun 06 13:20:52.742593 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 580/1185] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:52 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 1225 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:20:53.758876 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-716b0d66-f414-47eb-b0ce-73def7d253e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:53.759602 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-716b0d66-f414-47eb-b0ce-73def7d253e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: d88f29a9-f0a6-491c-9b00-a2e5430ad5f5] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:53.767064 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-716b0d66-f414-47eb-b0ce-73def7d253e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:53.767505 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-716b0d66-f414-47eb-b0ce-73def7d253e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:53.768281 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-716b0d66-f414-47eb-b0ce-73def7d253e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:53.768715 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-716b0d66-f414-47eb-b0ce-73def7d253e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:53.781782 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-716b0d66-f414-47eb-b0ce-73def7d253e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] HTTP exception thrown: Instance d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 could not be found. Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-716b0d66-f414-47eb-b0ce-73def7d253e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Request method failure captured: Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 HTTP/1.1 Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinf2MuCZsj-CgS1IjgHzRKLaRb-09GdyOYzcb2-rBEiujh8GyrbydjpigUkAXOCxWJF3i_9kSriSbQc-n2ge8Z7Xa93skgHqi5_t73d74O3toeuSN5vDYc4ZFAKN5ZHI3aurv3zrRGmc0sQVg9tta6C3u4ZzHg5RtzkBBPYHK-21VJ4g Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: 332996ee21f54ef3b78907332f5decce Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-TestVolumeBootPattern-810099065 Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:20:53.783911 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:20:53.785664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_332996ee21f54ef3b78907332f5decce", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/332996ee21f54ef3b78907332f5decce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/332996ee21f54ef3b78907332f5decce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/332996ee21f54ef3b78907332f5decce"}]}] Jun 06 13:20:53.785664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-TestVolumeBootPattern-810099065 Jun 06 13:20:53.785664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 332996ee21f54ef3b78907332f5decce Jun 06 13:20:53.785664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-TestVolumeBootPattern-810099065 Jun 06 13:20:53.785664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-TestVolumeBootPattern-810099065-project Jun 06 13:20:53.785664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:20:53.785664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:20:53.785664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: bd78c278513540ecadfc1a0f90b9ab16 Jun 06 13:20:53.785664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-TestVolumeBootPattern-810099065-project Jun 06 13:20:53.785664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:20:53.785664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 could not be found. Jun 06 13:20:53.785664 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': 'd88f29a9-f0a6-491c-9b00-a2e5430ad5f5'} Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 could not be found. Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:20:53.786641 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 could not be found. Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 could not be found. Jun 06 13:20:53.788300 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:53.789854 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-716b0d66-f414-47eb-b0ce-73def7d253e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Returning 404 to user: Instance d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:20:53.789854 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-716b0d66-f414-47eb-b0ce-73def7d253e0 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5" status: 404 len: 111 microversion: 2.1 time: 0.030584 Jun 06 13:20:53.789854 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 606/1186] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:53 2022] GET /compute/v2.1/servers/d88f29a9-f0a6-491c-9b00-a2e5430ad5f5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:20:54.283366 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4d324e74-03c8-465c-9f58-7881ba8daea3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:54.283934 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-4d324e74-03c8-465c-9f58-7881ba8daea3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:54.290216 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4d324e74-03c8-465c-9f58-7881ba8daea3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:54.290637 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4d324e74-03c8-465c-9f58-7881ba8daea3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:54.291382 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4d324e74-03c8-465c-9f58-7881ba8daea3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:54.291849 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-4d324e74-03c8-465c-9f58-7881ba8daea3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:54.305808 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-4d324e74-03c8-465c-9f58-7881ba8daea3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] HTTP exception thrown: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4d324e74-03c8-465c-9f58-7881ba8daea3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Request method failure captured: Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: DELETE /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 HTTP/1.1 Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinf2MuCZsj-CgS1IjgHzRKLaRb-09GdyOYzcb2-rBEiujh8GyrbydjpigUkAXOCxWJF3i_9kSriSbQc-n2ge8Z7Xa93skgHqi5_t73d74O3toeuSN5vDYc4ZFAKN5ZHI3aurv3zrRGmc0sQVg9tta6C3u4ZzHg5RtzkBBPYHK-21VJ4g Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 332996ee21f54ef3b78907332f5decce Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-TestVolumeBootPattern-810099065 Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:20:54.307413 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:20:54.309488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_332996ee21f54ef3b78907332f5decce", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/332996ee21f54ef3b78907332f5decce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/332996ee21f54ef3b78907332f5decce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/332996ee21f54ef3b78907332f5decce"}]}] Jun 06 13:20:54.309488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-TestVolumeBootPattern-810099065 Jun 06 13:20:54.309488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 332996ee21f54ef3b78907332f5decce Jun 06 13:20:54.309488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-TestVolumeBootPattern-810099065 Jun 06 13:20:54.309488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-TestVolumeBootPattern-810099065-project Jun 06 13:20:54.309488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:20:54.309488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:20:54.309488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: bd78c278513540ecadfc1a0f90b9ab16 Jun 06 13:20:54.309488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-TestVolumeBootPattern-810099065-project Jun 06 13:20:54.309488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:20:54.309488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:20:54.309488 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '787b0a77-8cba-4834-98e8-4524ac3e03d7'} Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:20:54.310803 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:20:54.312710 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:20:54.315059 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4d324e74-03c8-465c-9f58-7881ba8daea3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Returning 404 to user: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:20:54.315059 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-4d324e74-03c8-465c-9f58-7881ba8daea3 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "DELETE /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 404 len: 111 microversion: 2.1 time: 0.029286 Jun 06 13:20:54.315059 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 581/1187] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:20:54 2022] DELETE /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 13:20:54.317817 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-27c8f9d4-f28a-4ac0-aabd-0eaaba6336fe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:54.318471 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-27c8f9d4-f28a-4ac0-aabd-0eaaba6336fe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] [instance: 787b0a77-8cba-4834-98e8-4524ac3e03d7] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:20:54.324436 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27c8f9d4-f28a-4ac0-aabd-0eaaba6336fe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:54.324874 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27c8f9d4-f28a-4ac0-aabd-0eaaba6336fe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:54.325621 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27c8f9d4-f28a-4ac0-aabd-0eaaba6336fe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:20:54.326047 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-27c8f9d4-f28a-4ac0-aabd-0eaaba6336fe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:20:54.339022 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.wsgi [None req-27c8f9d4-f28a-4ac0-aabd-0eaaba6336fe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] HTTP exception thrown: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-27c8f9d4-f28a-4ac0-aabd-0eaaba6336fe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Request method failure captured: Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: request: GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 HTTP/1.1 Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept: application/json Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Accept-Encoding: identity Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Connection: close Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Length: 0 Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Content-Type: application/json Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Host: 10.222.0.13 Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Openstack-System-Scope: None Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: User-Agent: python-urllib3/1.26.9 Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Auth-Token: gAAAAABinf2MuCZsj-CgS1IjgHzRKLaRb-09GdyOYzcb2-rBEiujh8GyrbydjpigUkAXOCxWJF3i_9kSriSbQc-n2ge8Z7Xa93skgHqi5_t73d74O3toeuSN5vDYc4ZFAKN5ZHI3aurv3zrRGmc0sQVg9tta6C3u4ZzHg5RtzkBBPYHK-21VJ4g Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Id: None Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Domain-Name: None Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Identity-Status: Confirmed Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Is-Admin-Project: True Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Id: default Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Domain-Name: Default Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Id: 332996ee21f54ef3b78907332f5decce Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Project-Name: tempest-TestVolumeBootPattern-810099065 Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Role: member,reader Jun 06 13:20:54.340517 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Roles: member,reader Jun 06 13:20:54.342272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_332996ee21f54ef3b78907332f5decce", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/332996ee21f54ef3b78907332f5decce"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/332996ee21f54ef3b78907332f5decce"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/332996ee21f54ef3b78907332f5decce"}]}] Jun 06 13:20:54.342272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant: tempest-TestVolumeBootPattern-810099065 Jun 06 13:20:54.342272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Id: 332996ee21f54ef3b78907332f5decce Jun 06 13:20:54.342272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-Tenant-Name: tempest-TestVolumeBootPattern-810099065 Jun 06 13:20:54.342272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User: tempest-TestVolumeBootPattern-810099065-project Jun 06 13:20:54.342272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Id: default Jun 06 13:20:54.342272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Domain-Name: Default Jun 06 13:20:54.342272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Id: bd78c278513540ecadfc1a0f90b9ab16 Jun 06 13:20:54.342272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: X-User-Name: tempest-TestVolumeBootPattern-810099065-project Jun 06 13:20:54.342272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: method: > Jun 06 13:20:54.342272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: exception: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:20:54.342272 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: action_args: {'id': '787b0a77-8cba-4834-98e8-4524ac3e03d7'} Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:20:54.343355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. Jun 06 13:20:54.345246 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: ERROR nova.api.openstack.wsgi Jun 06 13:20:54.346803 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-27c8f9d4-f28a-4ac0-aabd-0eaaba6336fe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Returning 404 to user: Instance 787b0a77-8cba-4834-98e8-4524ac3e03d7 could not be found. {{(pid=118133) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:20:54.346803 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-27c8f9d4-f28a-4ac0-aabd-0eaaba6336fe tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7" status: 404 len: 111 microversion: 2.1 time: 0.027817 Jun 06 13:20:54.346803 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 607/1188] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:20:54 2022] GET /compute/v2.1/servers/787b0a77-8cba-4834-98e8-4524ac3e03d7 => generated 111 bytes in 29 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Jun 06 13:20:55.842092 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-4e105631-fc6d-49b7-ad2b-a57a61c2ca18 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] Calling method '.version_select at 0x7f0ef67bddc0>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:20:55.907482 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-4e105631-fc6d-49b7-ad2b-a57a61c2ca18 tempest-TestVolumeBootPattern-810099065 tempest-TestVolumeBootPattern-810099065-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-182726226" status: 202 len: 0 microversion: 2.1 time: 0.069286 Jun 06 13:20:55.908542 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 582/1189] 10.222.0.13 () {58 vars in 1259 bytes} [Mon Jun 6 13:20:55 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-182726226 => generated 0 bytes in 71 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:21:24.814082 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_cell1:SELECT=54,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:21:24.815187 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-bf06286e-1774-4f7c-b9eb-22009cce5918 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:21:24.815784 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bf06286e-1774-4f7c-b9eb-22009cce5918 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:21:24.816063 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG dbcounter [-] [118134] Writing DB stats nova_api:SELECT=27,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=118134) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:21:24.819346 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_api:SELECT=18 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:21:24.820119 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG dbcounter [-] [118133] Writing DB stats nova_cell1:SELECT=26 {{(pid=118133) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Jun 06 13:21:24.823213 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-9490f45f-4393-4bfa-bed4-f406ddcbd173 req-191eba28-ed25-477c-bc85-e73e0516c385 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "25c46a57-7fc5-427b-a56d-aa697322d8a8", "tag": "67b1981d-c58b-487a-92c4-bb105c0f52c3"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:21:24.824446 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bf06286e-1774-4f7c-b9eb-22009cce5918 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:21:24.824997 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bf06286e-1774-4f7c-b9eb-22009cce5918 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:21:24.826014 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bf06286e-1774-4f7c-b9eb-22009cce5918 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:21:24.826585 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-bf06286e-1774-4f7c-b9eb-22009cce5918 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:21:24.830216 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-9490f45f-4393-4bfa-bed4-f406ddcbd173 req-191eba28-ed25-477c-bc85-e73e0516c385 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:21:24.830896 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-9490f45f-4393-4bfa-bed4-f406ddcbd173 req-191eba28-ed25-477c-bc85-e73e0516c385 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:21:24.843520 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-9490f45f-4393-4bfa-bed4-f406ddcbd173 req-191eba28-ed25-477c-bc85-e73e0516c385 service nova] Creating event network-changed:67b1981d-c58b-487a-92c4-bb105c0f52c3 for instance 25c46a57-7fc5-427b-a56d-aa697322d8a8 on hv-cinder-75510 Jun 06 13:21:24.849187 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-9490f45f-4393-4bfa-bed4-f406ddcbd173 req-191eba28-ed25-477c-bc85-e73e0516c385 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036989 Jun 06 13:21:24.851876 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 583/1190] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:21:24 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Jun 06 13:21:24.855775 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-bf06286e-1774-4f7c-b9eb-22009cce5918 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Going to try to terminate instance {{(pid=118133) delete /opt/stack/nova/nova/compute/api.py:2664}} Jun 06 13:21:25.167783 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-bf06286e-1774-4f7c-b9eb-22009cce5918 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "DELETE /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 204 len: 0 microversion: 2.1 time: 0.357650 Jun 06 13:21:25.168338 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 608/1191] 10.222.0.13 () {58 vars in 1238 bytes} [Mon Jun 6 13:21:24 2022] DELETE /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 0 bytes in 359 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Jun 06 13:21:25.177747 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-7abf5361-c6e0-43bd-bbfd-a9c5b00d28b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:21:25.178445 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-7abf5361-c6e0-43bd-bbfd-a9c5b00d28b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:21:25.187091 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7abf5361-c6e0-43bd-bbfd-a9c5b00d28b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:21:25.187670 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7abf5361-c6e0-43bd-bbfd-a9c5b00d28b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:21:25.188737 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7abf5361-c6e0-43bd-bbfd-a9c5b00d28b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:21:25.189177 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-7abf5361-c6e0-43bd-bbfd-a9c5b00d28b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:21:25.335747 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.policy [None req-7abf5361-c6e0-43bd-bbfd-a9c5b00d28b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118134) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:21:25.343497 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-7abf5361-c6e0-43bd-bbfd-a9c5b00d28b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.170067 Jun 06 13:21:25.344226 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 584/1192] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:21:25 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:21:26.362587 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-92a5cdbc-e89b-4501-afb5-4f3f02a7a1b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:21:26.363315 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-92a5cdbc-e89b-4501-afb5-4f3f02a7a1b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:21:26.369908 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-92a5cdbc-e89b-4501-afb5-4f3f02a7a1b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:21:26.371066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-92a5cdbc-e89b-4501-afb5-4f3f02a7a1b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:21:26.371066 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-92a5cdbc-e89b-4501-afb5-4f3f02a7a1b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:21:26.371507 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-92a5cdbc-e89b-4501-afb5-4f3f02a7a1b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:21:26.506750 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-92a5cdbc-e89b-4501-afb5-4f3f02a7a1b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:21:26.514296 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-92a5cdbc-e89b-4501-afb5-4f3f02a7a1b8 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1567 microversion: 2.1 time: 0.156667 Jun 06 13:21:26.514851 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 609/1193] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:21:26 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1567 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Jun 06 13:21:27.369451 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [req-06fce33c-aca7-4ad5-a92f-a0fe10cd8813 req-9cbc07b3-9881-4cfb-bf6a-dfff5dec41b0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "25c46a57-7fc5-427b-a56d-aa697322d8a8", "name": "network-vif-deleted", "tag": "67b1981d-c58b-487a-92c4-bb105c0f52c3"}]} {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Jun 06 13:21:27.379644 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-06fce33c-aca7-4ad5-a92f-a0fe10cd8813 req-9cbc07b3-9881-4cfb-bf6a-dfff5dec41b0 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:21:27.380088 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [req-06fce33c-aca7-4ad5-a92f-a0fe10cd8813 req-9cbc07b3-9881-4cfb-bf6a-dfff5dec41b0 service nova] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:21:27.390947 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.compute.server_external_events [req-06fce33c-aca7-4ad5-a92f-a0fe10cd8813 req-9cbc07b3-9881-4cfb-bf6a-dfff5dec41b0 service nova] Creating event network-vif-deleted:67b1981d-c58b-487a-92c4-bb105c0f52c3 for instance 25c46a57-7fc5-427b-a56d-aa697322d8a8 on hv-cinder-75510 Jun 06 13:21:27.395832 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [req-06fce33c-aca7-4ad5-a92f-a0fe10cd8813 req-9cbc07b3-9881-4cfb-bf6a-dfff5dec41b0 service nova] 10.222.0.13 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030038 Jun 06 13:21:27.396402 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 585/1194] 10.222.0.13 () {64 vars in 1317 bytes} [Mon Jun 6 13:21:27 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Jun 06 13:21:27.533355 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-aa1f1925-0adc-4538-bf20-785d9fc5ec30 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:21:27.533970 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.compute.api [None req-aa1f1925-0adc-4538-bf20-785d9fc5ec30 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118133) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:21:27.540531 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa1f1925-0adc-4538-bf20-785d9fc5ec30 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:21:27.540980 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa1f1925-0adc-4538-bf20-785d9fc5ec30 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:21:27.541739 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa1f1925-0adc-4538-bf20-785d9fc5ec30 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:21:27.542175 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG oslo_concurrency.lockutils [None req-aa1f1925-0adc-4538-bf20-785d9fc5ec30 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118133) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:21:27.604291 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.policy [None req-aa1f1925-0adc-4538-bf20-785d9fc5ec30 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'eaa2b82129ac4f8796fdd57cad8e0bfb', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5a011dc568b04d8a91935a613d951b1c', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=118133) authorize /opt/stack/nova/nova/policy.py:199}} Jun 06 13:21:27.612557 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-aa1f1925-0adc-4538-bf20-785d9fc5ec30 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 200 len: 1217 microversion: 2.1 time: 0.083831 Jun 06 13:21:27.613127 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 610/1195] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:21:27 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 1217 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Jun 06 13:21:28.630739 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-09fedca6-df73-446b-b70b-b731f639693d tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '>' {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:21:28.631556 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.compute.api [None req-09fedca6-df73-446b-b70b-b731f639693d tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] [instance: 25c46a57-7fc5-427b-a56d-aa697322d8a8] Fetching instance by UUID {{(pid=118134) get /opt/stack/nova/nova/compute/api.py:2920}} Jun 06 13:21:28.637636 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-09fedca6-df73-446b-b70b-b731f639693d tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:21:28.638147 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-09fedca6-df73-446b-b70b-b731f639693d tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:21:28.638904 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-09fedca6-df73-446b-b70b-b731f639693d tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:386}} Jun 06 13:21:28.639335 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG oslo_concurrency.lockutils [None req-09fedca6-df73-446b-b70b-b731f639693d tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Lock "96733054-82d0-4cbf-8560-31148af40a94" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=118134) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:400}} Jun 06 13:21:28.653293 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.wsgi [None req-09fedca6-df73-446b-b70b-b731f639693d tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] HTTP exception thrown: Instance 25c46a57-7fc5-427b-a56d-aa697322d8a8 could not be found. Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-09fedca6-df73-446b-b70b-b731f639693d tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Request method failure captured: Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: request: GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 HTTP/1.1 Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept: application/json Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Accept-Encoding: identity Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Connection: close Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Length: 0 Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Content-Type: application/json Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Host: 10.222.0.13 Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Openstack-System-Scope: None Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: User-Agent: python-urllib3/1.26.9 Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Auth-Token: gAAAAABinf44Mp3lxDIpls4Z3AiTjVtKKgENvEXdWs3ydSM9DeKO_qU7nedbrXpbrzee4Z9kCpOtsMxpkY0hZgvUfkDMhVcBRBuHrOFSb3lgQifpzBDUlz6z6Ze7v625AGV09LaQ5XWbKdK78Qb5WsZEu7ag728Uo2iLEzi1kWKWWldpIFH2nZQ Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Id: None Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Domain-Name: None Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Identity-Status: Confirmed Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Is-Admin-Project: True Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Id: default Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Domain-Name: Default Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Id: 5a011dc568b04d8a91935a613d951b1c Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Project-Name: tempest-TestShelveInstance-283134946 Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Role: member,reader Jun 06 13:21:28.654890 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Roles: member,reader Jun 06 13:21:28.657481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/identity"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:9696/"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/image"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13:8080/v1/AUTH_5a011dc568b04d8a91935a613d951b1c", "adminURL": "http://10.222.0.13:8080"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2.1"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a011dc568b04d8a91935a613d951b1c"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/volume/v3/5a011dc568b04d8a91935a613d951b1c"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/placement"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.13/compute/v2/5a011dc568b04d8a91935a613d951b1c"}]}] Jun 06 13:21:28.657481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant: tempest-TestShelveInstance-283134946 Jun 06 13:21:28.657481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Id: 5a011dc568b04d8a91935a613d951b1c Jun 06 13:21:28.657481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-Tenant-Name: tempest-TestShelveInstance-283134946 Jun 06 13:21:28.657481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User: tempest-TestShelveInstance-283134946-project Jun 06 13:21:28.657481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Id: default Jun 06 13:21:28.657481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Domain-Name: Default Jun 06 13:21:28.657481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Id: eaa2b82129ac4f8796fdd57cad8e0bfb Jun 06 13:21:28.657481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: X-User-Name: tempest-TestShelveInstance-283134946-project Jun 06 13:21:28.657481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: method: > Jun 06 13:21:28.657481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: exception: Instance 25c46a57-7fc5-427b-a56d-aa697322d8a8 could not be found. Jun 06 13:21:28.657481 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: action_args: {'id': '25c46a57-7fc5-427b-a56d-aa697322d8a8'} Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: {{(pid=118134) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2923, in get Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2870, in _get_instance Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2827, in _get_instance_from_cell Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 25c46a57-7fc5-427b-a56d-aa697322d8a8 could not be found. Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Jun 06 13:21:28.658598 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = self._get_server( Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 25c46a57-7fc5-427b-a56d-aa697322d8a8 could not be found. Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 25c46a57-7fc5-427b-a56d-aa697322d8a8 could not be found. Jun 06 13:21:28.660457 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: ERROR nova.api.openstack.wsgi Jun 06 13:21:28.662399 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: DEBUG nova.api.openstack.wsgi [None req-09fedca6-df73-446b-b70b-b731f639693d tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Returning 404 to user: Instance 25c46a57-7fc5-427b-a56d-aa697322d8a8 could not be found. {{(pid=118134) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Jun 06 13:21:28.662399 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO nova.api.openstack.requestlog [None req-09fedca6-df73-446b-b70b-b731f639693d tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8" status: 404 len: 111 microversion: 2.1 time: 0.031326 Jun 06 13:21:28.662399 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: [pid: 118134|app: 0|req: 586/1196] 10.222.0.13 () {58 vars in 1235 bytes} [Mon Jun 6 13:21:28 2022] GET /compute/v2.1/servers/25c46a57-7fc5-427b-a56d-aa697322d8a8 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Jun 06 13:21:28.891986 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: DEBUG nova.api.openstack.wsgi [None req-4d4f6bca-5c1f-447f-8657-25d5248b2eb5 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] Calling method '.version_select at 0x7f0ef6d944c0>' {{(pid=118133) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Jun 06 13:21:28.991913 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO nova.api.openstack.requestlog [None req-4d4f6bca-5c1f-447f-8657-25d5248b2eb5 tempest-TestShelveInstance-283134946 tempest-TestShelveInstance-283134946-project] 10.222.0.13 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-306216519" status: 202 len: 0 microversion: 2.1 time: 0.104323 Jun 06 13:21:28.992494 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: [pid: 118133|app: 0|req: 611/1197] 10.222.0.13 () {58 vars in 1250 bytes} [Mon Jun 6 13:21:28 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-306216519 => generated 0 bytes in 106 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Jun 06 13:21:45.680242 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 13:21:45.680932 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Mon Jun 6 13:21:45 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 13:22:12.673663 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 13:22:12.674088 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Mon Jun 6 13:22:12 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 13:23:40.187959 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 13:23:40.187959 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Mon Jun 6 13:23:40 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 13:23:43.560164 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 13:23:43.560752 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Mon Jun 6 13:23:43 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 13:23:44.426351 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 13:23:44.426629 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Mon Jun 6 13:23:44 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 13:23:58.032927 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 13:23:58.038331 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Mon Jun 6 13:23:58 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 13:25:05.688506 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 13:25:05.689244 dv-cinder-755101-10-iscsi devstack@n-api.service[118133]: Mon Jun 6 13:25:05 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!! Jun 06 13:25:32.684254 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Jun 06 13:25:32.684924 dv-cinder-755101-10-iscsi devstack@n-api.service[118134]: Mon Jun 6 13:25:32 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) !!!